-- Logs begin at Wed 2022-05-11 05:08:06 UTC, end at Wed 2022-05-11 06:13:50 UTC. -- May 11 05:43:01.262983 dv-cinder-733623-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 05:43:01.270493 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 05:43:01 2022] *** May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: nodename: dv-cinder-733623-13-iscsi May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: machine: x86_64 May 11 05:43:01.272508 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: clock source: unix May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: pcre jit disabled May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: detected number of CPU cores: 4 May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: current working directory: / May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: detected binary path: /usr/bin/uwsgi-core May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: your processes number limit is 47680 May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: your memory page size is 4096 bytes May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: detected max file descriptor number: 2048 May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: lock engine: pthread robust mutexes May 11 05:43:01.272852 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: thunder lock: enabled May 11 05:43:01.274035 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 05:43:01.274035 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 05:43:01.318560 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: Python main interpreter initialized at 0x560391a7a9c0 May 11 05:43:01.318560 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: python threads support enabled May 11 05:43:01.318560 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: your server socket listen backlog is limited to 100 connections May 11 05:43:01.318560 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: your mercy for graceful operations on workers is 90 seconds May 11 05:43:01.318933 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: mapped 403077 bytes (393 KB) for 2 cores May 11 05:43:01.319008 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: *** Operational MODE: preforking *** May 11 05:43:01.319273 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: *** uWSGI is running in multiple interpreter mode *** May 11 05:43:01.319273 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: spawned uWSGI master process (pid: 80056) May 11 05:43:01.319480 dv-cinder-733623-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 05:43:01.323424 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: spawned uWSGI worker 1 (pid: 80069, cores: 1) May 11 05:43:01.323424 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: spawned uWSGI worker 2 (pid: 80070, cores: 1) May 11 05:43:01.323424 dv-cinder-733623-13-iscsi devstack@keystone.service[80056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 05:43:07.059215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:43:07.059215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes May 11 05:43:07.060185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:43:07.060185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: from cryptography.utils import int_from_bytes May 11 05:43:07.060621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:43:07.060621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes May 11 05:43:07.061389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:43:07.061389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: from cryptography.utils import int_from_bytes May 11 05:43:07.110396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:43:07.110572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:43:07.110766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] command line args: [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:43:07.110986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:43:07.111081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:43:07.111226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:43:07.111306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ================================================================================ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:43:07.111373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] command line args: [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:43:07.111432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.111632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:43:07.111715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_dir = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.111855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ================================================================================ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:43:07.111941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_source = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] admin_token = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] debug = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_dir = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.112685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.113910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.113910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.113910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_source = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] debug = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_config_append = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_dir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.114878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.115227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.115433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.115602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.115833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.116002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_config_append = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.116198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.116391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.116580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.116852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_dir = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.117066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.117237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.117432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.117634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.117855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.118963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.119348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.119542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.119738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.119933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.120984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] publish_errors = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.121964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] standard_threads = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] publish_errors = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.122855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_journal = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_json = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.123966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_stderr = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_syslog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] standard_threads = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.124841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.124841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.125081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.125081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.125326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.125505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_journal = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.125665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.125802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_json = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.125802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_stderr = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.126045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.126176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_syslog = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.126301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.126432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:43:07.126573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.126700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.126836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.126962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.127961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.128988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.129915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.130953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.131882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.132015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.132145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.132278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.132983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.133928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.134910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.135922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.136966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137327 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.137892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.138914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.139255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.139455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.139646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.139832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.140982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.141206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.141379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.141650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.141876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.142991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.143178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.143371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.143607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.143772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.143960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.144898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.145958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.146727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.147922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.148649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.148785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.148919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.149994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.150859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.151880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.152918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.153992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.154895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.external = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.155920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.password = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.156926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.token = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.157931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.158964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.external = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.159880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.password = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.token = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.160999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.161928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.162826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.163918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.164903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.165984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.166990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.167893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.168936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.169995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.170925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.171960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.172995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.173968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.174985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.175895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.176914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.177983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.178888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179143 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.179874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.180953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.181946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.182964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.183238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.184281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.185899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.185899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.185899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.185899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.186457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.186593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.186721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.186848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.186985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.187875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.188787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.189875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.190924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.191986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.192895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.193963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.194733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.195441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.195441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.195715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.195844 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.195971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.196888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.197955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.198979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.199882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.200933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.201994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.202912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.203935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.204968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.205939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.206966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.207094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.208227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.209295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.210391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.213164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.214245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:43:07.214245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:43:07.230602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.230838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.231064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.239848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.240071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.240310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.240543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.249553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.268757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.268998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.270979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.271215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.323967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.324211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.376757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.376995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.381089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.381328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.444939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.445109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.445335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.445502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.445754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.446069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.446403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.469241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.469501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.469757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.469846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.470776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.471065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.471380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.471693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.472003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.482968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.483322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.498050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.498415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.498743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.499066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.499399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.499717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.500033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.501331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.501627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.501883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.502109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.502380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.502603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.502819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 05:43:07.518373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.518700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 05:43:07.518862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.519077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 05:43:07.519305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.519412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.519612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 05:43:07.519743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 05:43:07.519878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.520136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.520218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.520392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.520645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.520724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.521062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.521410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.532152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.532428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.532692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.532967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.533731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.534115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.534492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.534894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.541700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.544367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.544953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.545231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.545647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.545933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.546217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.546485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.546757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.547029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.547296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.547565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.547831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.548867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.549255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.549665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.550159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.550551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.550917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.551293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.551698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.552065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.552442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.552810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.574606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.576176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.576461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.579819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.581610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.581781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.582060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.582142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.582338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.588433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.588872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.589264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.590733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.591032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.595693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.595977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.596255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.596534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.596809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.597087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.597356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.597647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.597870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.598255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.603656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.604057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.604448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.604837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.605236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.605645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.606034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.606406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.617188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.617510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.621996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.625443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.625582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.625875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.625957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.630559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.630809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.634407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.634612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.634913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.638580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.638874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.639154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.639433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.639707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.639982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.640852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.644544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.649095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.649526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.649923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.650314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.650698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.651083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.659757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.660128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.660398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.660662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.668574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.670312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.670587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.670927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.671406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.671780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.672152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.673634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.673917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.674203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.674486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.674761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.681170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.683016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.683402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.686587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.686978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.687365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.687787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.688172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.688644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.688920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.689208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.689514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.689797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.690087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.690361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.702726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.703128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.703527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.703925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.704324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.704703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.705088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.708459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.712259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.715657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.717228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.718889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.719169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.719461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.725205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.726906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.728508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.728942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.731721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.732008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.732291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.732566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.732758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.734517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.736273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.736658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.737057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.741777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.742084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.742444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.744924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.746665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.750022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.750423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.750505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.750697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.750963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.751046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.751300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.751492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.751590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.751840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.752112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.752398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.752669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.752935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.753202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.753556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.753760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.754032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.762520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.762936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.763325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.771350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 05:43:07.771745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.772133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.772548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.773006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.773399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.773802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.774190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.774565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.774940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.775314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.775697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.776067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.776457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 05:43:07.794261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560391a7a9c0 pid: 80069 (default app) May 11 05:43:07.797677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6467-9421-4ddc-906e-f42feaa1e37d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:07.797975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6467-9421-4ddc-906e-f42feaa1e37d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:07.798262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6467-9421-4ddc-906e-f42feaa1e37d None None] PATH_INFO: `/v3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:07.802988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Wed May 11 05:43:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:07.816733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560391a7a9c0 pid: 80070 (default app) May 11 05:43:15.711612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:15.712182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:15.712182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:15.713498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:15.720830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:15.721222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:15.721407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:15.751725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG oslo_db.sqlalchemy.engines [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:43:15.935428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG passlib.handlers.bcrypt [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80070) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 05:43:15.935843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG passlib.handlers.bcrypt [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80070) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 05:43:15.992420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:15.994059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:16.115927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1/3] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 05:43:16.275776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:16.309195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG oslo_db.sqlalchemy.engines [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:43:16.436763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340e59-0577-4d52-9935-91f44e6433f1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:16.441000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:16.441694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:16.441986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:16.442266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:16.450478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:16.502361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 05:43:16.502703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb521204-ded4-47df-9f62-70d99fb08cc2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:16.513036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1324 bytes} [Wed May 11 05:43:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 05:43:16.518763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:16.533439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c718d-d947-404f-b3f2-7a52391d816a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:16.537802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:16.539077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:16.539370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:16.539649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] PATH_INFO: `/v3/projects/092ac42400414e84802b398999ca7422` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:16.541310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] RBAC: Authorizing `identity:get_project(project_id=092ac42400414e84802b398999ca7422)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:16.592882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 05:43:16.593220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b890-a367-43c3-81d1-48806866df0f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:16.597864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 2/5] 10.222.0.44 () {56 vars in 1207 bytes} [Wed May 11 05:43:16 2022] GET /identity/v3/projects/092ac42400414e84802b398999ca7422 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:18.814198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a021a-113b-4384-b489-c4603a0c9866 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:18.814734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a021a-113b-4384-b489-c4603a0c9866 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:18.814835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a021a-113b-4384-b489-c4603a0c9866 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:18.818959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 4/6] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:18.825142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500659c2-19ec-4509-8854-21a67573a249 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:18.825551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500659c2-19ec-4509-8854-21a67573a249 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:18.825737 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500659c2-19ec-4509-8854-21a67573a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:18.845610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-500659c2-19ec-4509-8854-21a67573a249 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:18.847139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-500659c2-19ec-4509-8854-21a67573a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:18.855087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 05:43:18.877557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a021a-113b-4384-b489-c4603a0c9866 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:18.889707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a021a-113b-4384-b489-c4603a0c9866 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:18.893909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:18.894543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:18.894832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:18.895113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:18.903226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:18.905007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b733ab-97f8-4326-907f-71fce19bd6cd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:18.914246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1324 bytes} [Wed May 11 05:43:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 05:43:18.919751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500659c2-19ec-4509-8854-21a67573a249 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:18.928635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500659c2-19ec-4509-8854-21a67573a249 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:18.933273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:18.934162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:18.934451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:18.934728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:18.936131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:18.938007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f33a0-ce4b-457d-9279-68e7a2f69160 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:18.939570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 4/9] 10.222.0.44 () {56 vars in 1198 bytes} [Wed May 11 05:43:18 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:21.208297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5a0-f8f2-464d-87c0-b07a32a248c8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.208776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5a0-f8f2-464d-87c0-b07a32a248c8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.208871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5a0-f8f2-464d-87c0-b07a32a248c8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.210798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:21.216045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7073-3499-42a0-b998-6823ce976157 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.216484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7073-3499-42a0-b998-6823ce976157 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.216587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7073-3499-42a0-b998-6823ce976157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.251190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047481-91ae-4239-97ae-82073d445395 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.251482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047481-91ae-4239-97ae-82073d445395 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.251769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047481-91ae-4239-97ae-82073d445395 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.253150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 7/11] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:21.260439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.260731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.261015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.304738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80069) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 05:43:21.305175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80069) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 05:43:21.342527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-692a7073-3499-42a0-b998-6823ce976157 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:21.343717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-692a7073-3499-42a0-b998-6823ce976157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:21.354630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:21.356230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:21.421001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 5/12] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:21.443725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a7073-3499-42a0-b998-6823ce976157 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.456510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 8/13] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:21.479498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.539674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a7073-3499-42a0-b998-6823ce976157 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:21.571983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:21.572770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.573064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.573345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.578423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0285-5d53-4361-bf23-fb114bbc5f7b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:21.583985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:21.595632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:21.596713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:21.597733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:21.601868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 6/14] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:21.602517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.611998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:21.612915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.613210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.613509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.682606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:21.684179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:21.697061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c6dd-6879-4abf-a078-2ff865830753 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:21.729159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:21.729844 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.730130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.730414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.731159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:21.731463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:21.733125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:21.744449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 7/15] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:21.749965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.782186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 9/16] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:43:21.787395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.847166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972b89-4fb6-4bbd-bb10-ecba6f0ebc53 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:21.884640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:21.885569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:21.885853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:21.886127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:21.887680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:21.889179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:21.890920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 8/17] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:21.896267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:21.989374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d5b54-a3f9-4e86-92b7-4270b267813f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:21.996292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c48-020e-4dfe-9e04-8628e4333285 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:22.021639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:22.022424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:22.022744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:22.022744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:22.024289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:22.025745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:22.027668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 9/18] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:22.029151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:22.029979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:22.030267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:22.030542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:22.032986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:22.049592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:22.051070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:43:22.072656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:22.073616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:22.074608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:43:22.074608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:43:22.074608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:43:22.074608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:22.077612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 10/19] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:22.079553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:22.126718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f00-702a-42b0-a3ae-82082cea9160 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:22.158735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:22.159383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:22.159669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:22.159947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:22.160772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.domain.id=default, user.id=f9be91d729474890b96917c482066429) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:22.161084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:22.162557 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7134df3-fb71-4059-9fae-7618a86b0659 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:22.169734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 10/20] 10.222.0.44 () {56 vars in 1322 bytes} [Wed May 11 05:43:22 2022] GET /identity/v3/role_assignments?user.id=f9be91d729474890b96917c482066429&scope.domain.id=default&role.id=9086c2b2021041caa06abc9556a262a5 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:22.173390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49363e6-1e69-48bb-aa5b-3c3b17da1af4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:22.211724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:22.212399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:22.212689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:22.212970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:22.213754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:22.214070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:22.215499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f702278-ac0e-4dd8-9913-cfca312b0218 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:22.236153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 11/21] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:24.686604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446702a3-36a8-4f50-ab28-424fd9d607b1 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:24.687613 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446702a3-36a8-4f50-ab28-424fd9d607b1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:24.688110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446702a3-36a8-4f50-ab28-424fd9d607b1 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:24.690026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 11/22] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:24.706476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a58b8-727f-43c5-9d79-8aa8b46203f8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:24.706990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a58b8-727f-43c5-9d79-8aa8b46203f8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:24.707062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a58b8-727f-43c5-9d79-8aa8b46203f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:24.732842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8c1a58b8-727f-43c5-9d79-8aa8b46203f8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:24.734102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8c1a58b8-727f-43c5-9d79-8aa8b46203f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:24.819153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 12/23] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:24.861702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446702a3-36a8-4f50-ab28-424fd9d607b1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:24.914834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035f0a-2223-4aef-ba60-4cde86280b39 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:24.915145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035f0a-2223-4aef-ba60-4cde86280b39 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:24.915403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9035f0a-2223-4aef-ba60-4cde86280b39 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:24.917168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:24.942002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:24.942587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:24.943060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:24.974927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:24.977140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:24.997573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446702a3-36a8-4f50-ab28-424fd9d607b1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.043774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.044577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.044863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.045140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.057053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d42f423c-9381-413b-aac6-e9b3cc40842a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:25.065046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:25.065977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:25.066717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 12/25] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:25.068855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efaddc-3b25-43e2-aa96-d0b209f2d170 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.068855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efaddc-3b25-43e2-aa96-d0b209f2d170 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.068855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efaddc-3b25-43e2-aa96-d0b209f2d170 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.071390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 13/26] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:25.083034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.083327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.083615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.101790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:25.102921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.122530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:25.123760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:25.205006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043f59a-577e-4d0c-adf8-038f1b750fa5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.248326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 14/28] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:25.249446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.269943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.270866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.271297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.271719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.272647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:25.274533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.276434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.297591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 15/29] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:25.299388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.386418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e65c-2dd3-4e58-9a56-768f2d11d6e1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.426063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.426992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.427410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.427820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.429250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.431248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.509875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780904-7b01-4dd5-b227-e43dd1833474 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.552979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.554409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.555063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.555063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.571741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 15/30] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 11 05:43:25 2022] POST /identity/v3/roles => generated 219 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:25.573090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.578697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.581098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:43:25.612195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:25.613055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:25.613882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:43:25.613882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:43:25.613882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:43:25.613882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:25.613882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 16/31] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:25.619935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.700956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd99a2-5eac-4a2d-835e-6323cf40e80b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.747409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.748686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.749208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.749738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.751328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.753197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.755655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 16/32] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:25 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:25.774486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493256-0b00-4635-a45d-1ad49033d910 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.776031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.823393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.824093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.824486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.824671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.825394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:25.825734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.827224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.844152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 17/33] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:25.849997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:25.907924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de911b2c-c70e-4927-93f5-53e8434eb457 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:25.954049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:25.955253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:25.955800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:25.956340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:25.957904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:25.959636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:25.963961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 17/34] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:25.969714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:26.020209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f3a15-330f-439c-934e-7474a4025e0a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.094208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.095219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.096475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.102038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.103098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.104995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60a52-3117-4133-8147-ef8d935c5e18 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.148386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339ad4-724a-4a4f-868f-6d655c223940 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.190458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.191437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.191727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.192049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] PATH_INFO: `/v3/domains/default/users/f9be91d729474890b96917c482066429/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.194157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f9be91d729474890b96917c482066429, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.196026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee08d7-8081-4b4e-b4b0-9ee91a62f81c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.219159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 18/35] 10.222.0.44 () {58 vars in 1361 bytes} [Wed May 11 05:43:25 2022] PUT /identity/v3/domains/default/users/f9be91d729474890b96917c482066429/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:43:26.220788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4c5c-aced-499c-8356-d83ed643ccc2 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.221085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4c5c-aced-499c-8356-d83ed643ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.221367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4c5c-aced-499c-8356-d83ed643ccc2 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.222825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:26.228997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.229301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.229636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.249558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:26.251186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:26.286436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:43:25 2022] POST /identity/v3/projects => generated 301 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:26.357844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492c38-cb2f-441b-ab01-1d482b895e7b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.358023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492c38-cb2f-441b-ab01-1d482b895e7b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.358313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492c38-cb2f-441b-ab01-1d482b895e7b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.359807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 19/38] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:26.377464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 20/39] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:26.380506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b73d0-affe-49c8-89ed-c00792130bdf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.380800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b73d0-affe-49c8-89ed-c00792130bdf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.381088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b73d0-affe-49c8-89ed-c00792130bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.402651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:26.420022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-318b73d0-affe-49c8-89ed-c00792130bdf None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:26.424533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-318b73d0-affe-49c8-89ed-c00792130bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:26.558035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 20/40] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:26.562681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d02ef-5d49-4ba3-b04b-c43e15e20f59 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.576561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a21e-a47c-4277-8dea-54afc51f0010 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.576904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a21e-a47c-4277-8dea-54afc51f0010 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.577201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a21e-a47c-4277-8dea-54afc51f0010 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.578864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 21/41] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:26.584610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.585561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.586321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.602873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.603796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.604230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.604486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:26.604804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.605766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.606110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:26.607671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.627487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 21/42] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/roles => generated 225 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:43:26.634444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:26.703972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 22/43] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:26.729004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:26.754366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d99d1-05ad-4f53-91ab-e466a3d3a200 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.795383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.796568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.797048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.797494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.798985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.800629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.802594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 22/44] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:26.810055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:26.838708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9c4f4-e281-4e24-a12c-a99b8f0858c3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.874407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.875094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.875371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.875668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.876407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.878077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18cd7-6de9-4e93-bfb1-1809f71c7fca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.895654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 23/45] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:43:26.918814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ea65a-0c63-441e-9570-c1793edd7825 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:26.954756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:26.955441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:26.955729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:26.956007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:26.956741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:26.958284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2bf8f-8c59-4491-9ca9-4803edfcf7f1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:26.987362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:43:26 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:43:28.600652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d48-2d71-4739-b47c-289eab72d88b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:28.601167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d48-2d71-4739-b47c-289eab72d88b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:28.601264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468d48-2d71-4739-b47c-289eab72d88b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:28.602638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 24/47] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:28.607775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:28.608188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:28.608340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:28.625096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:28.626295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:28.689398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:28.713450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468d48-2d71-4739-b47c-289eab72d88b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:28.811623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468d48-2d71-4739-b47c-289eab72d88b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:28.844429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:28.845220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:28.845536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:28.845826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:28.856739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:28.865494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:28.866466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:28.867339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 25/49] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:28.872595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:28.967986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30b843-41cf-46bc-8d55-ff0ac9cdbd53 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.000148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.000814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.001105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.001391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.002238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:29.002555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.004232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.013160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 25/50] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:29.018946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:29.119348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65712818-47f3-4194-ac2c-2571f201bd26 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.153560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.154389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.154682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.154967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.156416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.157932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df3f8b-00c7-4c52-810c-0e1fa2a9163c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.159773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 26/51] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:29 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:29.165615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:29.208195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb912f-9b26-4f20-b1fc-1e7bad525453 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.208487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb912f-9b26-4f20-b1fc-1e7bad525453 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.208772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb912f-9b26-4f20-b1fc-1e7bad525453 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.210796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 27/52] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:29.215790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.216081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.216365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.233358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:29.234606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:29.263333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e56ea2-7dcb-48cc-84fd-2218d60ff501 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.295930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.296733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.297021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.297303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.298505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.299757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 28/53] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:29.299941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.306038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 26/54] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:29.307383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:29.322684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:29.404261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba97e97-36b1-4f73-91ae-77f524e8a33a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.416105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ca2-6622-4775-a2ee-b4d35d62b70b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.436352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.437011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.437303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.437624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.438461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.domain.id=default, user.id=f9be91d729474890b96917c482066429) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:29.438780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.440228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.446715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.447493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.447775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.448053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.448907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 29/55] 10.222.0.44 () {56 vars in 1322 bytes} [Wed May 11 05:43:29 2022] GET /identity/v3/role_assignments?user.id=f9be91d729474890b96917c482066429&scope.domain.id=default&role.id=9086c2b2021041caa06abc9556a262a5 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:29.449212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.450683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78fad-d8d5-43c7-9905-d9392d95e4bb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.452283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 27/56] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:29.457862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:29.568068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a350f-248c-4cb8-a09e-026ca422823a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:29.604289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:29.604977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:29.605246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:29.605563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:29.606293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:29.607765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52458a0d-74b0-40a1-ac32-bab04d43062f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:29.634837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 30/57] 10.222.0.44 () {60 vars in 1140 bytes} [Wed May 11 05:43:29 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:31.865457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878495-d024-4478-8082-bd218cfac00c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:31.866030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878495-d024-4478-8082-bd218cfac00c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:31.866706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878495-d024-4478-8082-bd218cfac00c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:31.868078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 28/58] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:31.873302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:31.873721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:31.873904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:31.890471 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:31.891669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:31.954040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 31/59] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:31.978362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78878495-d024-4478-8082-bd218cfac00c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:32.073382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78878495-d024-4478-8082-bd218cfac00c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:32.104925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:32.105720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:32.106006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:32.106281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:32.107440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:32.108868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2a60-dfb9-4508-81ca-2d865e2d1bfc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:32.110476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 29/60] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:32.116003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:32.208402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e8ca-3d2a-46e5-b142-630b9d50e4a2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:32.240421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:32.241110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:32.241402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:32.241714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:32.242417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:32.243874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227eba0-441a-423b-a238-78ceeef02741 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:32.268514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 32/61] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:32 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:35.533851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef862-3ade-4032-bc0b-01e106d05325 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:35.534936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef862-3ade-4032-bc0b-01e106d05325 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:35.535435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef862-3ade-4032-bc0b-01e106d05325 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:35.537414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 30/62] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:35.543948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac6f3-6e9f-478d-842b-d965f5f936a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:35.544787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac6f3-6e9f-478d-842b-d965f5f936a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:35.545260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac6f3-6e9f-478d-842b-d965f5f936a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:35.570865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-58dac6f3-6e9f-478d-842b-d965f5f936a1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:35.572414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-58dac6f3-6e9f-478d-842b-d965f5f936a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:35.655762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 33/63] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:35.696126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fef862-3ade-4032-bc0b-01e106d05325 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:35.748398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc52cb-6e20-4b8a-8873-e4c925df8242 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:35.749168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc52cb-6e20-4b8a-8873-e4c925df8242 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:35.749771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc52cb-6e20-4b8a-8873-e4c925df8242 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:35.752785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 34/64] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:35.759267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:35.760142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:35.760932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:35.796218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:35.799627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:35.850190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fef862-3ade-4032-bc0b-01e106d05325 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:35.891662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:35.892466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:35.892753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:35.893030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:35.913912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:35.921840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:35.923330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:35.924938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:35.927101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 31/65] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:35.932278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:35.956257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 35/66] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:35.998232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.228191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3f7c-39cd-4286-8f4b-9a0e6bf0e1a2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.262850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.263527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.263814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.264097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.264851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:36.265160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:36.266584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b5585-33f0-4b45-821a-cf6c53ad22ff None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:36.274907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 32/67] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:36.276167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd079-7b2a-4b7d-9a3e-53a2a950419a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.276515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd079-7b2a-4b7d-9a3e-53a2a950419a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.276801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd079-7b2a-4b7d-9a3e-53a2a950419a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.278418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 33/68] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:36.281858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b4d1-f286-40a3-876a-2af001edb105 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.283837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd079-7b2a-4b7d-9a3e-53a2a950419a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.316288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.317197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.317446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.317700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.328848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e2322e94-622c-45f8-a41c-3ebf0276706d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:36.336651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:36.338496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 36/69] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:36.339945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6766-2d17-4ce0-a83f-d6f58078f115 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.341242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6766-2d17-4ce0-a83f-d6f58078f115 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.341242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6766-2d17-4ce0-a83f-d6f58078f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.356769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cbdc6766-2d17-4ce0-a83f-d6f58078f115 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:36.357971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cbdc6766-2d17-4ce0-a83f-d6f58078f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:36.415663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd079-7b2a-4b7d-9a3e-53a2a950419a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.420990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 37/70] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:36.422156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715538d3-0c8c-48aa-ae36-d001b370ee18 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.422445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715538d3-0c8c-48aa-ae36-d001b370ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.422724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715538d3-0c8c-48aa-ae36-d001b370ee18 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.423979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 38/71] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:36.424669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715538d3-0c8c-48aa-ae36-d001b370ee18 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.454705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.455503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.455794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.456080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.469085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:36.470611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26305372-be11-4d92-89c2-94f4081aeb65 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:36.472274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 34/72] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:36.473495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556c06f-05d5-4b5d-87e4-362caba8f241 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.473784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556c06f-05d5-4b5d-87e4-362caba8f241 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.474066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556c06f-05d5-4b5d-87e4-362caba8f241 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.475981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 35/73] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:36.477004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.477421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.477731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.493925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:36.495107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:36.525737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715538d3-0c8c-48aa-ae36-d001b370ee18 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.557309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:36.558174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.560609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.562055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.562351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.562635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.563387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:36.563700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:36.565146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:36.578903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 39/75] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:36.578903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.652117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290e18-f16c-4fc5-8241-71e8425e2753 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.667812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a346-a802-43bd-b84a-6cadf76f1594 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.684420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.685227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.685542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.685828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.696386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:36.699879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.700519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.700804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.701080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d488e0a0-ae5a-44c9-9d0a-b019a6e305e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:36.704449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:36.705366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:36.706158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 37/76] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:36.707255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.707443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.707726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.723377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:36.724553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:36.765760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:36.767232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:36.787729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 38/77] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:36.788801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.860640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 40/78] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:36.861513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.881163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21eaa-5aa2-4472-9c5e-f0103f475668 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.913839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.914744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.915032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.915316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:36.916525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:36.918021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:36.919639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 39/79] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:36.920402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:36.956531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509331f9-9f14-4446-a171-40f1bdaaf761 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:36.988591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:36.989381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:36.989703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:36.989992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.000326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:37.008266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:37.009209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 41/80] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:37.010294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.018200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6007e-748f-49bd-82ba-cd10336747a8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.050839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.051502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.051918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.052199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.052942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:37.053257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.055247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.062882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 40/81] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.063671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.105703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa966c1-68c5-494a-9cf4-9149842d52bd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.138034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.138830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.139127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.139412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.140694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.142203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.143990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 42/82] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.144581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.157446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83782db-370b-48d2-8ff1-3fba92fb0610 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.192267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.193245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.193592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.194414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.195644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.197104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.198850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 41/83] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.199612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.239395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d641a4-3e2d-4d28-90d2-3f2b94e5a8fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.271690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.272933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.273205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.273526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.292102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbf59e-40dd-4174-9fcb-ad446b23918c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.324898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.325587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.325880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.326163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.326903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:37.327218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.328586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.337182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 42/84] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.337519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.338027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.339087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.430813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a566-20d9-415f-b2dc-a26d6657d0fc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.431975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 43/85] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:37.432791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.463481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.464343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.464643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.464924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.466133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.467579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.469202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 43/86] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.469202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.527177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4712622-76d1-4f58-9a21-ccfb5b5fc7a4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.559429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.560092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.560383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.560664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.561373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.562159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae6e0b-c555-4581-bdde-7165e02b7c63 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.562872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.593504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 44/87] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:37 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:37.593504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.605504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.605504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.605504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.605504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.605970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:37.605970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.605970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.606465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 44/88] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=47bff6418933442081338f0ba924ff4a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.607337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.709915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bd32-fa01-416c-85ca-4ae7fd4336cd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.736268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaaf63-17c3-40d6-b524-f5b0f5a0c49c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.748314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.749220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.749533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.749819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.751149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.752849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.755029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 45/89] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.755886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.775829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.776716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.777005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.777346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.778684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.780501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:37.782496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 45/90] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:37.783367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:37.870721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9aff-b75c-46ad-85ce-1a600c14cde4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.899942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a513-86e2-4757-a033-b34cc33c6d82 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:37.905686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.906351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.906640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.906928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.951384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:37.952046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:37.952338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:37.952619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:37.976867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:37.978368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.034576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.036395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.091238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 46/91] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:38.092102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:38.148924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 46/92] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:38.150141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:38.221159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d823-3a8a-477d-a2c5-146f165df5cd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:38.258484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:38.259150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:38.259436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:38.259718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:38.260550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=f9be91d729474890b96917c482066429) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:38.260864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.262750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.268626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 47/93] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:38 2022] GET /identity/v3/role_assignments?user.id=f9be91d729474890b96917c482066429&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:38.269434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:38.417994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb7320-af04-43c8-b53f-7155f9fb5e9e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:38.459477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:38.460399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:38.460685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:38.460965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] PATH_INFO: `/v3/projects/f1bca2b90b634e83ab451e9c04615032` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:38.462350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] RBAC: Authorizing `identity:get_project(project_id=f1bca2b90b634e83ab451e9c04615032)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.464402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.466436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 48/94] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:38 2022] GET /identity/v3/projects/f1bca2b90b634e83ab451e9c04615032 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:38.472718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:38.479574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805c69-ec0e-46bb-8888-9f02b610e74e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:38.578233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:38.579119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:38.579405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:38.579683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:38.580986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.582495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.584247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 47/95] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:38 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:38.592416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ee57-abe5-434d-85e5-e3f8f0a41c22 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:38.607386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:38.630371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:38.631035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:38.631863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:38.632152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:38.633178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=f1bca2b90b634e83ab451e9c04615032, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:38.633513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.635391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d53a3-5d8b-4db8-a89a-c71d1e1c5c42 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.646027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 49/96] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:38 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=f1bca2b90b634e83ab451e9c04615032&role.id=47bff6418933442081338f0ba924ff4a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:38.801950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecbbe-fa08-4648-93ab-4af7c7e0f406 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:38.837697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:38.838386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:38.838678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:38.838956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:38.839824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:38.840142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:38.841684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab0fc5-045f-4621-865d-a8f68d0ffa27 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:38.848122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 48/97] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:38 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:40.105698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846051e-c14f-48b6-b6b3-e80afb21c636 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.106735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846051e-c14f-48b6-b6b3-e80afb21c636 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.107221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846051e-c14f-48b6-b6b3-e80afb21c636 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.108801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 50/98] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:40.114468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.115407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.115950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.138378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:40.139907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:40.222306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 49/99] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:40.256065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846051e-c14f-48b6-b6b3-e80afb21c636 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:40.365203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846051e-c14f-48b6-b6b3-e80afb21c636 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:40.399612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:40.400413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.400700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.400978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.411063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:40.419526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:40.420380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:40.421132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 51/100] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:40.427522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:40.525647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af525-9933-4906-94a4-dabcffcbaa74 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:40.559403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:40.560076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.560364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.560642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.561388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:40.561729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:40.563123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:40.571414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 50/101] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:40.577018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:40.680359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bd7d0-7f28-43ec-b74f-b53e84032f04 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:40.713983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:40.714862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.715145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.715422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.716650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:40.718140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:40.719838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 52/102] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:40 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:40.725959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:40.846449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed06a1-3401-4902-8f98-0ea346511d0a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:40.885948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:40.887408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.887876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.888332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.889745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:40.891395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab8952-605f-4a75-8461-137c2d6cfe1d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:40.893659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 51/103] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:40 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:40.900694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:40.984580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc311f-4dac-49c3-829e-afac855ef646 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:40.985407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc311f-4dac-49c3-829e-afac855ef646 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:40.985920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc311f-4dac-49c3-829e-afac855ef646 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:40.988532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 52/104] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:41.001254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.002130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.002614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.030101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:41.032267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:41.044593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1899-9798-4b09-a946-52721291c0c2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:41.134766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:41.135856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.135961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.136216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/users/36f404a5c807416aa172abb7a3dc43fe/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.142777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, user_id=36f404a5c807416aa172abb7a3dc43fe, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:41.144238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:41.155658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 53/105] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:41.174259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 53/106] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:40 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/users/36f404a5c807416aa172abb7a3dc43fe/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:41.197863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:41.318264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53126c-b704-4416-abf7-58ae81edae37 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:41.363675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:41.364501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.364789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.365073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.387021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:41.395111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:41.396021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:41.396770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:41.398605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 54/107] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:41.402848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:41.532785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35c06e-df18-4d5b-868c-9d796eeabfd5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:41.572845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:41.573487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.573788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.574074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.574856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:41.575172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:41.576631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8602f0-a336-4301-be0f-28f0e8c99967 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:41.586954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 54/108] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:41.592235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:41.722323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a89-87a3-49e4-bbe0-7ab7aa706a90 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:41.735352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f632df-9fb0-43fe-a7a5-00d9a5e94373 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.735646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f632df-9fb0-43fe-a7a5-00d9a5e94373 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.735936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f632df-9fb0-43fe-a7a5-00d9a5e94373 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.737457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 55/109] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:41.743708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a430ab-231e-455a-b341-4776b510a693 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.744005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a430ab-231e-455a-b341-4776b510a693 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.744295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a430ab-231e-455a-b341-4776b510a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.769779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:41.770666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.770957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.771241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] PATH_INFO: `/v3/users/5cc6d86c7fe945b2a52025e257f87078` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.778501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-70a430ab-231e-455a-b341-4776b510a693 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:41.779732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-70a430ab-231e-455a-b341-4776b510a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:41.798787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc6d86c7fe945b2a52025e257f87078)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:41.800267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:41.802205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 55/110] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:41 2022] GET /identity/v3/users/5cc6d86c7fe945b2a52025e257f87078 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:41.807504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:41.888575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 56/111] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:41.889938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ae90-6522-420a-84e2-9c2d63ec49ad None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.890235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ae90-6522-420a-84e2-9c2d63ec49ad None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.890517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ae90-6522-420a-84e2-9c2d63ec49ad None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.891901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 57/112] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:41.898770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:41.899137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:41.899340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:41.927457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:41.929235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:42.033581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 58/113] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:42.034493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.044193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96b691-f93d-47fd-872e-5dab76dcbc10 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.112668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.113683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.113982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.114269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.169198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9469e1-2487-47a4-9c30-15caf66e1fb9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.198287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.201361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.212024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.213011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.213437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.213881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.215324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.216977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49738680-df64-42d4-9876-711fce6654e4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.219148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 59/114] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:42.220540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd37e8c-5272-47f6-9b56-df134822c466 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.221022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd37e8c-5272-47f6-9b56-df134822c466 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.221571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd37e8c-5272-47f6-9b56-df134822c466 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.227242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 60/115] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:42.228394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd37e8c-5272-47f6-9b56-df134822c466 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.331839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 56/116] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:43:42.331839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.346186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd37e8c-5272-47f6-9b56-df134822c466 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.389991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.391125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.391422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.391708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.405874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-16ee6770-935c-4e5c-b8d4-9e79d7fe4510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:42.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:42.416664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:42.417433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 61/117] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:42.423260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.423260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.423260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.439429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:42.440581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:42.443524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478310-8d5a-49a8-897b-96605a488609 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.477355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.478048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.478339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.478675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.479380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.480842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.509357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 57/118] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:43:42 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:42.513718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.515975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 62/119] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:42.521683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.627130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1454dc9-cf47-4a0c-aca6-b867717d59ff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.646313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a957f-6f6c-40d1-a557-c70221eb432b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.665530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.666223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.666514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.666801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.667575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:42.667887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.669333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8334c-67a2-46be-b77f-d9ea86f0c439 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.683933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 63/120] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:42.685353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c18b7-5522-4cf8-96fd-f0bca87ae078 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.685677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c18b7-5522-4cf8-96fd-f0bca87ae078 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.685967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c18b7-5522-4cf8-96fd-f0bca87ae078 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.688318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 64/121] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:42.689301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c18b7-5522-4cf8-96fd-f0bca87ae078 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.689842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.690886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.691304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.691716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.693132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.695494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.697390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 58/122] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:42.698331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.809090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d576b-7d2b-4773-92ec-a74a6b3fbec0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.814154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c18b7-5522-4cf8-96fd-f0bca87ae078 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:42.849043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.850010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.850311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.850596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.851814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:42.853935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57737-fe06-4e18-86d4-e07d0fcef4d9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:42.854737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:42.855325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 59/123] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:42.855890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.856331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.857057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.861011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:42.861314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:42.861642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:42.872378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:42.880046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:42.880774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:42.883050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:42.883934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:42.884543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:42.888519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 65/124] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:42.889680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:42.954421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 60/125] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:42.955367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.026394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae92d-af04-4102-afae-75949ceb3b3d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.073861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.074860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.075303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.075723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.076694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=5cc6d86c7fe945b2a52025e257f87078) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:43.077163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.078837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.079367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51f95d-5f78-446c-bb6e-8f49176b5e2f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.085604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 66/126] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/role_assignments?user.id=5cc6d86c7fe945b2a52025e257f87078&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:43.086625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.123791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.124689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.125134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.125562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.127027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.129183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.133553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 61/127] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:42 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:43.135036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.218811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ee33-6939-4e59-b2ca-3499b754589e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.257335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.258115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.258409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.258695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.259518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:43.259837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.261254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.266063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fce2f9-90a8-4e20-b317-0ec6179a7174 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.278175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 67/128] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:43.279141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.309401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.310279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.310565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.310843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.323257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:43.333702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:43.335550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 62/129] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:43.337056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.410241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d1fd-0b44-44d6-8023-08be65596058 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.446433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.447779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.448278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.448822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/users/f9be91d729474890b96917c482066429/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.451133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, user_id=f9be91d729474890b96917c482066429, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.452853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.468213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8db4-0cdd-46a2-b756-5c41ac12f66c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.476119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 68/130] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:43 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/users/f9be91d729474890b96917c482066429/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:43.477381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.517943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.519406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.519716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.520054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.521657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.523799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.526584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 63/131] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:43.537115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.696247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c586-b9d5-43ba-b8a8-7ad63afc1ea1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.737075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.737998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.738289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.738570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] PATH_INFO: `/v3/projects/f1bca2b90b634e83ab451e9c04615032` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.740256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] RBAC: Authorizing `identity:get_project(project_id=f1bca2b90b634e83ab451e9c04615032)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.742131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.744611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 64/132] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/projects/f1bca2b90b634e83ab451e9c04615032 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:43.751129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.770916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45190b-d579-43a7-9a14-6ceabe033e2e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:43.850919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:43.851677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:43.851971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:43.852257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:43.853026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:43.853341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:43.857116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:43.874723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 69/133] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:43.909373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:43.948568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc940ce-acf4-4170-9f24-fac3e977fb5b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.034838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.035664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.035854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfc63d-db45-4c43-9758-7fe61e2adee3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.035958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.036218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] PATH_INFO: `/v3/projects/f1bca2b90b634e83ab451e9c04615032/users/36f404a5c807416aa172abb7a3dc43fe/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.042986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1bca2b90b634e83ab451e9c04615032, user_id=36f404a5c807416aa172abb7a3dc43fe, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:44.044465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:44.071664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 65/134] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:43 2022] PUT /identity/v3/projects/f1bca2b90b634e83ab451e9c04615032/users/36f404a5c807416aa172abb7a3dc43fe/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:44.094248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.095170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.095462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.095749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.097058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:44.098680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:44.100628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 70/135] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:43 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:44.106642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:44.232229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd9812-c64e-4d1c-99cb-6747494990a5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.273593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.274478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.274767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.275050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.276310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:44.277818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314569e1-e726-4076-8aa8-37c0ebb1044b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:44.279757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 66/136] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:44 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:44.285348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:44.409125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbfdb5-e9e2-4b1b-bb4d-f3f464292de0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.409525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbfdb5-e9e2-4b1b-bb4d-f3f464292de0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.409708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbfdb5-e9e2-4b1b-bb4d-f3f464292de0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.411344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 67/137] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:44.421742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d75d2-ff40-425e-b156-aa9c11dfc463 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.431617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.431937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.432189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.456740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:44.456740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:44.481521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.482429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.482718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.482998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/users/36f404a5c807416aa172abb7a3dc43fe/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.490771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, user_id=36f404a5c807416aa172abb7a3dc43fe, role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:44.492515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:44.520869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 71/138] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:44 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/users/36f404a5c807416aa172abb7a3dc43fe/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:44.560009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:44.606098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:44.733717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a841-85a4-4963-a8d8-54f591b2ae26 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.780197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.781033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.781329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.781646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.796228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:44.804517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:44.805425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:44.806195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 72/140] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:44.814676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:44.934615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfd738-6fa1-48ee-a801-a0d77738eb5d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:44.972921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:44.973637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:44.973931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:44.974214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:44.975045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:44.975402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:44.976748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:44.985716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 69/141] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:44.991718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:45.138928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66da6f-689a-4263-a2c7-427abeeba9c7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:45.181077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:45.181990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.182287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.182573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.186671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:45.187653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:45.189308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 73/142] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:44 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:45.198985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:45.334318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837684d-9203-415f-a6a3-71c95b12137f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:45.376843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:45.377534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.377823 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.378103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.471458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:45.472876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:45.593636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 70/143] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:45.599259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:45.731521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6a27-374e-48d2-9758-9195a1e5c453 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:45.777935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:45.778802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.779089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.779367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.783723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:45.785159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3526d-2ab6-41f7-8068-88e969f24083 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:45.787200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 74/144] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:45 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:45.793261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:45.917011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f149e7-9fac-46cf-aee1-466c3b505cab None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:45.930396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd496-853c-4e69-a91f-0a4fae346081 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.930686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd496-853c-4e69-a91f-0a4fae346081 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.930969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfd496-853c-4e69-a91f-0a4fae346081 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.932538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 75/145] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:45.937383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.937702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.937981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.965608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:45.966805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:45.995084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:45.995672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:45.995958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:45.996235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:45.997086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:45.997402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:45.998947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:46.011023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 71/146] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:45 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=47bff6418933442081338f0ba924ff4a => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:46.081269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 76/147] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:46.122065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:46.247798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85fde-a880-428c-8168-f5685e33ead6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:46.283389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:46.284198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.284489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.284771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.285999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:46.288020 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc912fe-47d3-453a-9fe8-497007290418 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:46.293581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 72/148] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:46.298633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:46.401004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13ccc-ba5e-4822-8a46-34465485745a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.401558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13ccc-ba5e-4822-8a46-34465485745a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.401558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13ccc-ba5e-4822-8a46-34465485745a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.402941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 73/149] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:46.408066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644eece-365a-4529-b625-108f2e05df5f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.409059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644eece-365a-4529-b625-108f2e05df5f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.409059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644eece-365a-4529-b625-108f2e05df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.425723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9644eece-365a-4529-b625-108f2e05df5f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:46.426947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9644eece-365a-4529-b625-108f2e05df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:46.479177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22ca9-284f-4469-b4e1-170fe0b3b998 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:46.543370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 74/150] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:46.544457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:46.545148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.545435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.545750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.546466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:46.547958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:46.572343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 77/151] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:46 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:46.580510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644eece-365a-4529-b625-108f2e05df5f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:46.704381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644eece-365a-4529-b625-108f2e05df5f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:46.743016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:46.743852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.744141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.744421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.755638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:46.764834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:46.765771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:46.766528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 75/152] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:46.773420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:46.883805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a1ba-6555-4a66-b100-1644b6ad923e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:46.920798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:46.921132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:46.921357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:46.921659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:46.922421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:46.922729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:46.924135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45a12-c82a-42c3-a9c6-e89e14674191 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:46.934106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 78/153] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:46.939615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.040537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e018-9a4c-41ac-9ab5-0a6469874a89 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.048436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f5aa-a139-4e04-8b9d-22900d361c31 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.048733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f5aa-a139-4e04-8b9d-22900d361c31 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.048993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f5aa-a139-4e04-8b9d-22900d361c31 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.052299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 79/154] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:47.060737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.061041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.061330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.081710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:47.082896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:47.089298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.090492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.091039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.091519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] PATH_INFO: `/v3/users/5cc6d86c7fe945b2a52025e257f87078` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.094095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] RBAC: Authorizing `identity:get_user(user_id=5cc6d86c7fe945b2a52025e257f87078)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:47.096105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:47.099093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 76/155] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:46 2022] GET /identity/v3/users/5cc6d86c7fe945b2a52025e257f87078 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:47.104551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.158886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 80/156] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:47.182716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.208592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5585d-08cd-432c-8223-790810d1c23a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.243551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.244723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.245185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.245653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.247027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:47.248644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:47.250544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 77/157] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:47.256767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.286825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb535-3452-429c-91bd-40b48b7bc960 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.332203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.333110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.333492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.333859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.369547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:47.377320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:47.378247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:47.379007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 81/158] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:47.384728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.391210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8340-2d69-4db2-ba91-f4a92aa54b3a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.430185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.431987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.432484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.432957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/users/5cc6d86c7fe945b2a52025e257f87078/roles/10804984d16a4a90a036c9b94ff1eae1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.435329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, user_id=5cc6d86c7fe945b2a52025e257f87078, role_id=10804984d16a4a90a036c9b94ff1eae1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:47.437077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:47.454659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 78/159] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:47 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/users/5cc6d86c7fe945b2a52025e257f87078/roles/10804984d16a4a90a036c9b94ff1eae1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:43:47.494239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e3903-a921-48f7-bb3f-d443977a44e9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.534848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.535537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.535818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.536097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.536863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:47.537175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:47.539209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db559e58-56ca-4e36-a606-015eff0ddaf7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:47.553690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 82/160] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:47.558675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.673366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d871-5eae-48e2-a816-d90df6ea7522 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.673366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d871-5eae-48e2-a816-d90df6ea7522 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.673366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d871-5eae-48e2-a816-d90df6ea7522 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.676498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 83/161] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:47.681196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.681448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.681713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.706072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:47.707266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:47.713144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a4d0-d941-49de-8b16-6b06d6bd5527 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.760273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.761970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.762554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.763018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] PATH_INFO: `/v3/users/f9be91d729474890b96917c482066429` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.764477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be91d729474890b96917c482066429)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:47.767917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:47.770819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 79/162] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/users/f9be91d729474890b96917c482066429 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:47.777167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.809437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 84/163] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:47.847755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:47.905305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a814-6c80-4837-8f92-fbaa6b32d8d4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:47.943272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:47.943890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:47.944181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:47.944446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:47.978115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc9873-7b61-431d-afc4-928ae6789e81 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.014804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:48.016311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0ffc8-54da-450e-b1e5-446a44dcab9b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:48.016773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.017878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.018377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.018841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.030767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f01cb307-a53f-41ad-86da-dfefb7008f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:48.039346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:48.040194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:48.040984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:48.043356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 85/164] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:48.044987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef177-9866-42b0-82e8-94231c126ca1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.046201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef177-9866-42b0-82e8-94231c126ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.046694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef177-9866-42b0-82e8-94231c126ca1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.048261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 86/165] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:48.049148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef177-9866-42b0-82e8-94231c126ca1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.121756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 80/166] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:43:48.121756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.121756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.121756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.137649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:48.138985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:48.247162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef177-9866-42b0-82e8-94231c126ca1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.283167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 81/167] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:48.284165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.299659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.300335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.300621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.300909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.301696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:48.302010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:48.303454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:48.321414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 87/168] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:48.324224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.496417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc708e-9a5c-454b-aadb-41bbc29b7029 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.545249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7b370-576a-4668-80b6-d9d15e61a318 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.576493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.577369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.577675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.577952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.579815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:48.581267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:48.583008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 82/169] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:48.583786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.624689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.625525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.625815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.626095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.653989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:48.671331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:48.672199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:48.672943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 88/170] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:48.673765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.825215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528479f4-2d81-49b1-a3df-d1d6553d6114 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.866719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b653d1a-88e7-42da-8e56-5bcb136ac016 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:48.885747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.887212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.888297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.888963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.892495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:48.895018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:48.899744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 83/171] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:48.900780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:48.941647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:48.942822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:48.945285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:48.945785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:48.950278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=f9be91d729474890b96917c482066429) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:48.950831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:48.954978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:48.969507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 89/172] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/role_assignments?user.id=f9be91d729474890b96917c482066429&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:48.969507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.126956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c707-ff2a-4afc-9065-b7c2d93f6a11 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:49.229865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:49.230965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:49.231445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:49.231911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:49.232863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:49.233363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:49.235000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:49.236276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b58c7-436b-4655-826c-5cf3548d2d8b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:49.249019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 84/173] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:49.254980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.294942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:49.296216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:49.296694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:49.297206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:49.423270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f1e3-4efe-47c8-8dda-9b37d4023576 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:49.430425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:49.432283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:49.493679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:49.495566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:49.496585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:49.497649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] PATH_INFO: `/v3/users/36f404a5c807416aa172abb7a3dc43fe` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:49.501342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] RBAC: Authorizing `identity:get_user(user_id=36f404a5c807416aa172abb7a3dc43fe)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:49.505104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:49.513814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 85/174] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:49 2022] GET /identity/v3/users/36f404a5c807416aa172abb7a3dc43fe => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:49.528648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.656567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 90/175] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:49.660410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b328d7-a06c-4522-ba6c-3086086ba8fb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:49.661815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.698920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:49.699891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:49.700369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:49.700848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:49.768932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:49.770775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:49.864167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81435-7581-486d-b8ab-c3b65ce2a9d3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:49.869130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 86/176] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:43:49.877163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.923310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:49.924228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:49.924494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:49.924732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] PATH_INFO: `/v3/projects/f1bca2b90b634e83ab451e9c04615032` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:49.930310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] RBAC: Authorizing `identity:get_project(project_id=f1bca2b90b634e83ab451e9c04615032)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:49.931797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:49.933567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 91/177] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:49 2022] GET /identity/v3/projects/f1bca2b90b634e83ab451e9c04615032 => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:49.939300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:49.985024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf3221-4dfe-43cd-8a17-6548df4a806f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:50.019558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:50.020754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.021249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.021922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.023330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:50.024971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:50.026950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 87/178] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:49 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:50.033052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:50.073076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c709d9-4761-4fd3-9ac1-3392e7265656 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:50.107065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:50.107728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.108016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.108295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.109136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=f1bca2b90b634e83ab451e9c04615032, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:50.109437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:50.110903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fb25e-0219-4212-88b0-af43af1ffcfa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:50.117504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 92/179] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:49 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=f1bca2b90b634e83ab451e9c04615032&role.id=47bff6418933442081338f0ba924ff4a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:50.144193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c922-baae-40ae-8a74-3305b47f604f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:50.193577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:50.193577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.193577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.193577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.193962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=36f404a5c807416aa172abb7a3dc43fe) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:50.193962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:50.193962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db040-47c6-41b7-b465-9beef5dbd99b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:50.200387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 88/180] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:50 2022] GET /identity/v3/role_assignments?user.id=36f404a5c807416aa172abb7a3dc43fe&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:50.753184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8155d-7dcc-4435-a99b-bed04fd16ef6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.753578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8155d-7dcc-4435-a99b-bed04fd16ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.753782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8155d-7dcc-4435-a99b-bed04fd16ef6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.755415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 93/181] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:50.761239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.762459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.762928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.773092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1511b6-eaf9-4a52-baaa-539e13a5855a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.773764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1511b6-eaf9-4a52-baaa-539e13a5855a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.774248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1511b6-eaf9-4a52-baaa-539e13a5855a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.776184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 94/182] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:50.782449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:50.783077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:50.783671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:50.784417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:50.785697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:50.807279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:50.808863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:50.860507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 89/183] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:50.881304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 95/184] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:50.897359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:50.908208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.010155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bfe00-ba6a-4576-af20-7506e2dd6d29 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.013595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a3e8-4d94-43c6-86d7-b3d344847d20 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.047101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.047894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.048176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.048448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.048542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.049245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.049561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.049852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.051010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.052446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93077b73-cabd-454d-9db3-b508c2704d6b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.058521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 96/185] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.058521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1cac-bdbc-42a3-bbb6-1c50ed327f44 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.058521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1cac-bdbc-42a3-bbb6-1c50ed327f44 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.058521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1cac-bdbc-42a3-bbb6-1c50ed327f44 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.058521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 97/186] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:51.059208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1cac-bdbc-42a3-bbb6-1c50ed327f44 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.066765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-aa86eb4f-b103-45a1-9dfa-35ac95130923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:51.077096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:51.078127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:51.078899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 90/187] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:51.085141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d94e1-c4f1-4aba-abc1-d9bf176c82cf None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.085141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d94e1-c4f1-4aba-abc1-d9bf176c82cf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.085141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d94e1-c4f1-4aba-abc1-d9bf176c82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.099615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e95d94e1-c4f1-4aba-abc1-d9bf176c82cf None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:51.101363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e95d94e1-c4f1-4aba-abc1-d9bf176c82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:51.155245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1cac-bdbc-42a3-bbb6-1c50ed327f44 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.163189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 91/188] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:51.164541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbb54-d5ce-4580-b949-b0925be36aa8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.164828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbb54-d5ce-4580-b949-b0925be36aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.165102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbb54-d5ce-4580-b949-b0925be36aa8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.169508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 92/189] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:51.169508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cbb54-d5ce-4580-b949-b0925be36aa8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.199148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.199816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.200104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.200383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.201083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.202572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b1fc-74be-493b-b6f5-72b7d03128ea None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.221823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 98/190] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:51 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:51.225684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.225684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.225684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.241436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:51.242684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:51.282012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cbb54-d5ce-4580-b949-b0925be36aa8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.316076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 99/191] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:51.316582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.317262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.317572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.317834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.317949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.319130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:51.319448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.320891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.337589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 93/192] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.347164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.423680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d323ba5-434d-4a49-b1bc-0aa6558a42b4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.457686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.458615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c4df9-ca70-4415-ab59-34d4e19b0c51 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.458889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.459224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.459504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.470253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:51.478928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:51.479950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:51.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 100/193] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:51.481400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.498932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.499797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.500204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.500491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.513725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:51.521539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:51.523157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:51.523924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 94/194] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:51.524547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.592393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78df1-c58c-4ef5-8223-fbb8bfab704e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.634985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.636136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.637454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.637896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.647661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ec52-3e3f-432a-bf75-7320e076f5f5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.657727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.659437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.661315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 101/195] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.662300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.682510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.683325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.683728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.684102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.685009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:51.685415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.686967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.695571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 95/196] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.700776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.773557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae098-233a-470d-a2ad-48ef09e9f2b3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.798031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2fb4e-170b-479e-9642-d1197539cd17 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.809054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.810547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.811242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.811931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.813449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:51.813982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.815569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.824936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 102/197] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.826079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:51.832663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.833367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.833678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.834550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.904458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.906102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.930947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665429e-56f5-4f71-ba30-e692c121b95d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:51.967564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:51.968822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:51.969322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:51.969821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:51.971287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:51.972948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:51.975395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 103/198] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:51.980903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.005261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 96/199] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:52.006686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.083733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d4d82-9277-41c2-bdd0-f137a4204963 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.103724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea586b3-6652-4c00-8a71-58968c59ae3f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.121382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.122635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.123163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.123638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] PATH_INFO: `/v3/users/5cc6d86c7fe945b2a52025e257f87078` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.125197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc6d86c7fe945b2a52025e257f87078)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.126911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.128755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 104/200] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:51 2022] GET /identity/v3/users/5cc6d86c7fe945b2a52025e257f87078 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:52.129849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.138881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.139637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.139923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.140200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.212126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.213670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.247675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991115-9e80-48d7-8764-ebb53ca47f81 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.283113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.284358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.284852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.285323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.286742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.288525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.290496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 105/201] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:52.291458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.316709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 97/202] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:52.321517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.395087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee569-5a07-48ed-a2d6-057d5450ab98 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.418723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed69f8-4c63-43dc-ac94-83fd6860323d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.430343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.431082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.431440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.431792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.454961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.455552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.455840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.456122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.456956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=8326fb4aab3749edbf15df3122938d41) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:52.457278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.458790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.465462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 98/203] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/role_assignments?user.id=8326fb4aab3749edbf15df3122938d41&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:52.466269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.501974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.503531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.578379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fc205-293f-4a5a-b5b9-4806b51d81a7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.609335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 106/204] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:52.614627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.614894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.616408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.616820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.617113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.618469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.619979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.621779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 99/205] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:52.627757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.745717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1247612-fe0f-4a2e-b27e-590728405a3f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.770566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed26b-d9b8-4a6f-a543-b5563df5ef13 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:52.792357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.793226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.793523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.793806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.795077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.796907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.798510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 107/206] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:52.806446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:52.816461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:52.818181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:52.819877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:52.820387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:52.821429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=8326fb4aab3749edbf15df3122938d41) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:52.821967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:52.824122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435c41-da0d-40fc-85cc-a60732a8f977 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:52.830870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 100/207] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/role_assignments?user.id=8326fb4aab3749edbf15df3122938d41&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:52.981665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739a8-b327-4138-9cd7-a484cbd12d89 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:53.038511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:53.039117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:53.039404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:53.039685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:53.040535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, scope.project.id=04920a235511475bb804bcf2603bb3dd, user.id=5cc6d86c7fe945b2a52025e257f87078) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:53.040853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:53.042361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93223-ad83-4a5e-94e7-c6881cdf8500 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:53.048925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 108/208] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:52 2022] GET /identity/v3/role_assignments?user.id=5cc6d86c7fe945b2a52025e257f87078&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:53.750356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b88d-a7de-42cf-ba52-29a7d38c4a41 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:53.751091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b88d-a7de-42cf-ba52-29a7d38c4a41 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:53.751708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b88d-a7de-42cf-ba52-29a7d38c4a41 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:53.753294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 101/209] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:53.759097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:53.759942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:53.760543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:53.777514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:53.778977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:53.845954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 109/210] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:53.870313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95b88d-a7de-42cf-ba52-29a7d38c4a41 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:53.975896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95b88d-a7de-42cf-ba52-29a7d38c4a41 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.011163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.012564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.013066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.013554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.026251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-87e8a08f-279f-441f-8a6c-f39bc45eac16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:54.034367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:54.035275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:54.036034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:54.039008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 102/211] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:54.044837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.064223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5a17-ea00-4591-8509-0fed78dd7561 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.064851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5a17-ea00-4591-8509-0fed78dd7561 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.065340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5a17-ea00-4591-8509-0fed78dd7561 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.067399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 103/212] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:54.076058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.076585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.077056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.094292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:54.095807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:54.152408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb2e67-1f51-43ec-bf23-15d203f70812 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.169703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 104/213] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:54.187191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.187960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.188241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.189348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.190722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.191256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:54.191626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.193023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.206715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 110/214] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:54.207401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.293097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cd15-2dcb-4a0c-baea-3879ebf993b9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.306315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6ca9-86a5-4fc7-a2a4-a41fbdb1657d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.327201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.328292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.328766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.329228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.330647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.332303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.338826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 105/215] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:54.339971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.344310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.345441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.345942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.346410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] PATH_INFO: `/v3/users/146b0df3ff24493ab0c73101864e8bf4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.363327 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] RBAC: Authorizing `identity:get_user(user_id=146b0df3ff24493ab0c73101864e8bf4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.365995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.368672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 111/216] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/users/146b0df3ff24493ab0c73101864e8bf4 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:54.374049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.445385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92d32-cb97-4058-b544-1c4b0f712951 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.473911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ad510-d751-4cd9-9f0c-b333e08500e4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.480070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.481013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.481505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.481975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.482882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.484540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.514390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.515098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.522307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.522307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.522544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 106/217] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:54 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:43:54.597437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.598872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.712107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 112/218] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:54.718045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.820867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b4729-2bf9-424a-86cb-018c1af0a996 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:54.862007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:54.863390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:54.863866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:54.864342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:54.866291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:54.867991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b8a7-f629-4a58-b15c-d4d36a0493ff None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:54.869933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 107/219] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:54.875935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:54.999751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059f8f4-38fe-4dbc-8509-78d0767a1cc5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.024148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573243-91a2-48d3-89e7-efb59d77c149 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.024683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573243-91a2-48d3-89e7-efb59d77c149 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.024683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573243-91a2-48d3-89e7-efb59d77c149 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.026360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 108/220] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:55.032957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35b10-a03a-43ce-86aa-1f3275d5d65b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.033245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35b10-a03a-43ce-86aa-1f3275d5d65b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.033554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35b10-a03a-43ce-86aa-1f3275d5d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.041420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.042369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.042833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.043285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.045197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=146b0df3ff24493ab0c73101864e8bf4) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:55.045730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:55.047385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:55.055026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 113/221] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:54 2022] GET /identity/v3/role_assignments?user.id=146b0df3ff24493ab0c73101864e8bf4&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=47bff6418933442081338f0ba924ff4a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:55.058018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-10b35b10-a03a-43ce-86aa-1f3275d5d65b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:55.061072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-10b35b10-a03a-43ce-86aa-1f3275d5d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:55.144460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 109/222] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:55.167899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.178875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35939-9ca1-4639-944d-1fb27d49e3d6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.179193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35939-9ca1-4639-944d-1fb27d49e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.179437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35939-9ca1-4639-944d-1fb27d49e3d6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.181549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 110/223] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:55.186548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204682d-6acb-413c-b48b-affef5282582 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.186829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204682d-6acb-413c-b48b-affef5282582 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.187197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204682d-6acb-413c-b48b-affef5282582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.209959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2204682d-6acb-413c-b48b-affef5282582 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:55.215122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2204682d-6acb-413c-b48b-affef5282582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:55.320428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 111/224] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:55.329361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb89cf-c73c-4eab-93fb-ea37d766a212 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.342256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204682d-6acb-413c-b48b-affef5282582 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.368055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.368853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.369135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.369406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.388770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:55.397042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:55.397904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:55.398673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:55.399739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 114/225] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:55.406504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.530751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204682d-6acb-413c-b48b-affef5282582 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.554403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872d1c-3b86-47b0-a63c-e3af66aac5cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.572921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.574105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.574604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.575090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.593270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.594301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.595003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:55.595475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.595965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:55.604325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:55.605172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:55.605978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:55.607885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:55.608408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:55.610043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:55.617024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 112/226] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:43:55.624077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 115/227] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:55.625161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.629668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.754867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42d28-8035-4d5b-9728-ec5275217fa0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.796488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.797163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.797445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.797755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.798511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:55.798817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:55.800200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:55.813030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 113/228] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:55.818892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.861045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fc155-6082-4d10-a158-53deb23f73ee None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.934161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.935045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.935330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.935608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.936823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:55.938354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:55.940143 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 116/229] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:55.946774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd467d8-7bf8-4231-bff0-b59b7c9f85c0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:55.949582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:55.986264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:55.987187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:55.987469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:55.987743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:55.988991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:55.990911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:55.997517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 114/230] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:55.998851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:56.120586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9aa5-0947-4175-9738-0895b6e9cb75 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:56.168150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:56.169460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:56.170007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:56.170481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:56.172276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:56.174053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:56.179416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 115/231] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:56.185968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:56.193846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fbf5-eacb-4308-b8ac-f6aff9eb875c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:56.267483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:56.268726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:56.269207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:56.269707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:56.274222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:56.275929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:56.277939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 117/232] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:55 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:56.283973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:56.313978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10bb29-2246-48aa-8515-9f8832b2cdc6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:56.358798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:56.360096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:56.360585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:56.361055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/users/8326fb4aab3749edbf15df3122938d41/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:56.363709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, user_id=8326fb4aab3749edbf15df3122938d41, role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:56.366065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6f05-be5c-4270-9667-7fead944aacb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:56.398598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 116/233] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:56 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/users/8326fb4aab3749edbf15df3122938d41/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:56.426521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fc85-bf8c-45b7-8b63-f00229b08666 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:56.469173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:56.470115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:56.470401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:56.470681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/users/8326fb4aab3749edbf15df3122938d41/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:56.479133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, user_id=8326fb4aab3749edbf15df3122938d41, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:56.480620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1459-1ceb-486a-b24a-c0941ddb354d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:56.504274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 118/234] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:56 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/users/8326fb4aab3749edbf15df3122938d41/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:43:57.343250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7fa4-c60b-4659-9340-faf65874ad40 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.344249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7fa4-c60b-4659-9340-faf65874ad40 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.344733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7fa4-c60b-4659-9340-faf65874ad40 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.346331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 117/235] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:57.352390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405496-0868-4cd6-98f4-1fa7e7a0d3e8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.352844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405496-0868-4cd6-98f4-1fa7e7a0d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.353147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405496-0868-4cd6-98f4-1fa7e7a0d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.375343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c8405496-0868-4cd6-98f4-1fa7e7a0d3e8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:57.376533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c8405496-0868-4cd6-98f4-1fa7e7a0d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:57.460426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 119/236] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:57.500207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7fa4-c60b-4659-9340-faf65874ad40 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:57.526904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595b84-32c1-4ed2-9490-312a6c701ef1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.527216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595b84-32c1-4ed2-9490-312a6c701ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.527473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595b84-32c1-4ed2-9490-312a6c701ef1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.529205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 120/237] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:57.534554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.534843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.535141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.564841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:57.569307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:57.637499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7fa4-c60b-4659-9340-faf65874ad40 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:57.672591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:57.673437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.673746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.674021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.684864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:57.692602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:57.693544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:57.694485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 118/238] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:57.701500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:57.734810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 121/239] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:57.792042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:57.818426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e01d-1265-4450-a670-eef6b6d4b900 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:57.852939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:57.853970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.854548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.855017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.855952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:57.856447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:57.858058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c49f52-efb4-4471-9ea6-35c05307ce58 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:57.867404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 119/240] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:57.868976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e7cd7-86b3-4e4e-85f5-f8e4dca3795f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.869462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e7cd7-86b3-4e4e-85f5-f8e4dca3795f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.869950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e7cd7-86b3-4e4e-85f5-f8e4dca3795f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.871376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 120/241] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:57.876158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e7cd7-86b3-4e4e-85f5-f8e4dca3795f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:57.905456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f9409-81e4-4683-94b0-00c8b26c5c8f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:57.940870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:57.941692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.941977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.942256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.943475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:57.944921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f9a1-76c3-441f-a789-a003965a8245 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:57.946563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 122/242] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:57.947675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:57.947958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:57.948233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:57.969316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:57.970580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:57.993598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e7cd7-86b3-4e4e-85f5-f8e4dca3795f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.032560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.033439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.033750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.034029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] PATH_INFO: `/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.048940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] RBAC: Authorizing `identity:get_user(user_id=fbbfc538dc1f4e2a9b1c8cf3f82472b2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.050546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.052377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 121/243] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:57 2022] GET /identity/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:58.053211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.062960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 123/244] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:43:58.064391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.164498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0c69-1279-414d-9cda-6b6f4ff7d62b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.188011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc6d2-d737-4634-a3cc-0b86287e121b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.198494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.199167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.199452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.199726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.200433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.202000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.233497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 122/245] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:43:58 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:43:58.233497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.237897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.237897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.238260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.238621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.363028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407a34-8150-4945-b3bd-af49d4019a52 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.400469 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.402530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.444111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.444916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.445205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.445497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.471679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:58.481424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:58.482346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:43:58.483112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:58.484758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 123/246] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:58.492879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.524194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 124/247] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:43:58.529725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.603637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce6a02-0af2-4c7f-86db-e5e11c174044 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.632696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0db6a-1084-412c-966b-4d74e0dc881b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.638724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.639580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.640035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.640453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.641353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:58.641828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.643433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.654114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 124/248] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:58.660107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.676153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.677040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.677313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.678160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.680068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.681567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.683361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 125/249] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:58.689184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.765667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b14f-543a-409a-a905-038a4cc02d5c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.790631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb6db-0638-4b35-8369-ed57547a4393 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.799906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.801110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.801623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.802128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] PATH_INFO: `/v3/users/146b0df3ff24493ab0c73101864e8bf4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.803873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] RBAC: Authorizing `identity:get_user(user_id=146b0df3ff24493ab0c73101864e8bf4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.805604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.808677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 125/250] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/users/146b0df3ff24493ab0c73101864e8bf4 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:58.816904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:58.830064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.830738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.831039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.831303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.832533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=fbbfc538dc1f4e2a9b1c8cf3f82472b2) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:58.832857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.835071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.843469 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 126/251] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/role_assignments?user.id=fbbfc538dc1f4e2a9b1c8cf3f82472b2&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:58.940924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8d88-f01e-4dc5-bc15-12c9c1fde194 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:58.980569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:58.981540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:58.981832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:58.982160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:58.983393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:58.984861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cacb04-45f7-4559-bc32-3ddf67368e6a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:58.986954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 126/252] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:43:58 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:58.993437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.114162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515671a-c2df-4e30-a7c3-8a569ce7f412 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:59.135056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a3f4-9b17-4a90-907e-da67aeed7093 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.135358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a3f4-9b17-4a90-907e-da67aeed7093 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.135620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a3f4-9b17-4a90-907e-da67aeed7093 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.137254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 127/253] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:43:59.142508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7f7d-169b-4c5f-aff5-d096f05b0e51 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.142848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7f7d-169b-4c5f-aff5-d096f05b0e51 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.143138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7f7d-169b-4c5f-aff5-d096f05b0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.159191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:59.160093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.160380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.160660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/users/146b0df3ff24493ab0c73101864e8bf4/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.164797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, user_id=146b0df3ff24493ab0c73101864e8bf4, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:59.169530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:59.176366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ba7d7f7d-169b-4c5f-aff5-d096f05b0e51 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:59.176366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba7d7f7d-169b-4c5f-aff5-d096f05b0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:59.200923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 127/254] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:43:58 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/users/146b0df3ff24493ab0c73101864e8bf4/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:43:59.272168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 128/255] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:59.316656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.332877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe8e-306a-4463-ad11-7c0b54089777 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.333183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe8e-306a-4463-ad11-7c0b54089777 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.333442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe8e-306a-4463-ad11-7c0b54089777 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.335792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 129/256] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:43:59.341042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.341332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.341637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.373592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:43:59.374811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:43:59.474735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 130/257] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:43:59.486425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dc3f5-620c-4889-abcf-9fdff1ca6498 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:59.509593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.546071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:59.547072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.547364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.547647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.570617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:59.578827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:59.579727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:43:59.580483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:43:59.585974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 128/258] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:59.592149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.681246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de4a12-f5c8-4e79-bb0b-bc77edb71bbd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:59.723030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e5dab-a6c2-4954-8ea2-a4e17730e20a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:59.758771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:59.759005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:59.759682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.759974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.760254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.760537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.761016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.761490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.762688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:43:59.763184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:59.764750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:59.773829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 129/259] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:43:59.779510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.785143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:43:59.801645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:43:59.802632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:43:59.803397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 131/260] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:43:59.808812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:43:59.894369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab192-7573-4694-b6eb-582e15a40959 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:43:59.932246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:43:59.933990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:43:59.934495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:43:59.934964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:43:59.936358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:43:59.938169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:43:59.940793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 130/261] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:43:59.950982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:00.061079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f99da-b261-4c7a-ab29-77ddd6354a9e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.069713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263cc1-0f8e-45e6-b9b4-74b5272e3fff None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.106594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.107600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.108107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.108577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.154783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.155466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.155751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.156029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.156791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:00.157398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.158544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.182040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 132/262] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:00.190504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:00.200454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.203268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.299276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9dd31-b4a7-4f4b-b790-8f1ce91cd32b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.329675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 131/263] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:00.333297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.334906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.335196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.335471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] PATH_INFO: `/v3/users/8326fb4aab3749edbf15df3122938d41` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.336829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] RBAC: Authorizing `identity:get_user(user_id=8326fb4aab3749edbf15df3122938d41)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.337122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:00.338431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.341279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 133/264] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:00 2022] GET /identity/v3/users/8326fb4aab3749edbf15df3122938d41 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:00.346076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:00.453453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4100a-89a8-4d40-bd64-df10196581c9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.462502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99ee8-b2a7-4bfe-8a82-bee834f6ec66 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.500765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.502397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.503125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.503709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.505266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.508389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.511342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 132/265] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:00 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:00.517625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:00.544307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.545119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.545551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.545936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.720969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.722422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.737078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221564-e198-4ea4-84ad-18cbbef1289a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:00.819640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:00.820303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:00.820583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:00.820856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:00.821808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=8326fb4aab3749edbf15df3122938d41) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:00.822046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:00.823490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:00.843763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 133/266] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:00 2022] GET /identity/v3/role_assignments?user.id=8326fb4aab3749edbf15df3122938d41&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:00.870055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 134/267] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:00.875813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:01.031954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6118c6b-6f91-4714-8fc5-c291ba7841f6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:01.076888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:01.077786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:01.078076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:01.078350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:01.079565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:01.081037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af916db2-88ef-4b80-ab93-7f653674c529 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:01.083079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 134/268] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:00 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:01.089106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:01.280603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d9a49-3d37-4dc1-bd91-49c36da17600 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:01.324709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:01.325290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:01.325597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:01.325873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:01.326708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=8326fb4aab3749edbf15df3122938d41) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:01.327019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:01.328476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aba35-ad61-4911-ab20-29255c533867 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:01.338530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 135/269] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:01 2022] GET /identity/v3/role_assignments?user.id=8326fb4aab3749edbf15df3122938d41&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:01.809045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f126-914a-4dfe-bb49-954fab183844 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:01.809590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f126-914a-4dfe-bb49-954fab183844 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:01.809669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f126-914a-4dfe-bb49-954fab183844 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:01.810978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 135/270] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:01.816482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:01.816896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:01.817066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:01.836190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:01.837385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:01.906472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 136/271] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:01.932882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f126-914a-4dfe-bb49-954fab183844 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.052283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f126-914a-4dfe-bb49-954fab183844 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.091196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.091911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.092194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.092471 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.103138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6f45a3ac-5e79-4ca4-a330-57972278ccc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:02.114775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:02.116907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:02.117763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:02.118346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 136/272] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:02.123725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.164888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18896-bcc3-44b3-b9cf-a977c2e33eea None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.165239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18896-bcc3-44b3-b9cf-a977c2e33eea None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.165450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18896-bcc3-44b3-b9cf-a977c2e33eea None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.166982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 137/273] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:02.171828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05355-b6d8-490f-87ed-cc0983907a4f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.172119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05355-b6d8-490f-87ed-cc0983907a4f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.172407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05355-b6d8-490f-87ed-cc0983907a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.195148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dfc05355-b6d8-490f-87ed-cc0983907a4f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:02.196545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dfc05355-b6d8-490f-87ed-cc0983907a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:02.235955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7edd-07b9-4a23-9d66-c958f9864e7a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.272760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.273451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.273767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.274047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.274826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:02.275138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.276603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.279202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 138/274] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:02.280573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08010d2-cc09-443c-bc1c-f81fe8b1f7a8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.280858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08010d2-cc09-443c-bc1c-f81fe8b1f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.281133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08010d2-cc09-443c-bc1c-f81fe8b1f7a8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.282693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 139/275] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:02.288358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.288664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.288917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.294224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 137/276] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:02.301623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.308695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:02.309915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:02.379015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 140/277] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:02.379015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.406003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd141d-905b-426b-99a5-ab69972de4b5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.439862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.440732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.441017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.441294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] PATH_INFO: `/v3/users/06995ab442c84f28a6f002a53d6bc4b2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.455345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] RBAC: Authorizing `identity:get_user(user_id=06995ab442c84f28a6f002a53d6bc4b2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.456806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.458527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 138/278] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/users/06995ab442c84f28a6f002a53d6bc4b2 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:02.460546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.475922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91564a-146a-44f7-aa82-c78ac53af611 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.509301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.510117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.510409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.510683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.512175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.513675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca0401-f6db-4656-80c6-efcd5f20fc1f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.515281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 141/279] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:02.516507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadc7e-dfb9-492b-9e88-8caa2e3a2f5b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.516972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadc7e-dfb9-492b-9e88-8caa2e3a2f5b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.517137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadc7e-dfb9-492b-9e88-8caa2e3a2f5b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.518506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 142/280] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:02.522362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eadc7e-dfb9-492b-9e88-8caa2e3a2f5b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.556569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed94fe-f499-49d7-acb5-18fc6857e81f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.588140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.588922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.589203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.589502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.598979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:02.607047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:02.607919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:02.608680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 139/281] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:02.609320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.619996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eadc7e-dfb9-492b-9e88-8caa2e3a2f5b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.652071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.652652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.652940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.653222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.654071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, user.id=06995ab442c84f28a6f002a53d6bc4b2, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:02.654384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.655820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c179d-c829-4e5b-b929-0e4cc614fcd1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.660712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 143/282] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/role_assignments?user.id=06995ab442c84f28a6f002a53d6bc4b2&scope.system=all&role.id=47bff6418933442081338f0ba924ff4a => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:02.662655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.663220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.663512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.680982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:02.682232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:02.708080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9de6-6271-4557-b9be-969d9bb0081f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.743917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.744611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.744896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.745177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.745936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.747433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.752726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 144/283] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:02.753945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.781552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 140/284] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:02 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:02.782499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.874116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e7a1-e41e-4f85-a9b7-ce7fda4a9313 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.897958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd787b3-ad0d-4a3b-8036-7066a8f645a8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:02.922894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.924220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.924910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.925794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.927074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:02.928368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:02.931002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:02.934339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:02.935162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:02.935447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:02.935726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:02.942726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 145/285] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:02.948982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:02.951318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:02.960027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:02.960962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:02.961791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:02.964584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 141/286] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:02.974791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.070198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b092-c287-4309-9abf-d0df55233fa8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.101654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887ff6-b005-4fc0-8a64-3b97e709688c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.117918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.118922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.119276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.119627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] PATH_INFO: `/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.120938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] RBAC: Authorizing `identity:get_user(user_id=fbbfc538dc1f4e2a9b1c8cf3f82472b2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.122499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.128498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 146/287] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:03.129944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.149585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.150949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.151267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.151517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.152279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:03.152591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.154028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.163473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 142/288] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:03.168831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.277204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ede88f-2457-4d45-80c5-26f21ccdfedd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.297536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef665e-779e-44f2-a6bf-ae4f1e22b1a8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.324098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.324958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.325239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.325539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.328380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.329843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.331536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 147/289] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:03 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:03.338228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.346779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.347648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.347930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.348205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] PATH_INFO: `/v3/users/146b0df3ff24493ab0c73101864e8bf4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.351516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] RBAC: Authorizing `identity:get_user(user_id=146b0df3ff24493ab0c73101864e8bf4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.354588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.359611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 143/290] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:03 2022] GET /identity/v3/users/146b0df3ff24493ab0c73101864e8bf4 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:03.365152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.520187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4219c-8a25-4573-8f94-5738676d1004 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.521033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4c06-ba49-4d80-a48c-71aebcad8dd7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.569999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.571249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.571735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.572234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2/roles/10804984d16a4a90a036c9b94ff1eae1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.574066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.574734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.574841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, user_id=fbbfc538dc1f4e2a9b1c8cf3f82472b2, role_id=10804984d16a4a90a036c9b94ff1eae1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.575015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.575301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.576851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.596082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 148/291] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:03 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2/roles/10804984d16a4a90a036c9b94ff1eae1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:03.656945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.659005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.786056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 144/292] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:03.791915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:03.916864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabd65-cc97-4c20-9389-18fab4c21c25 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:03.952399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:03.953816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:03.954312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:03.954832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:03.956245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:03.957944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e6d-10c4-4168-9344-cdd2ae0e8bd9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:03.960714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 149/293] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:03 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:03.966249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:04.077388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eef02d-bf5d-4f65-8dde-5990e087e302 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:04.121068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:04.122189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:04.122702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:04.123174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:04.124196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=146b0df3ff24493ab0c73101864e8bf4) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:04.124704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:04.126361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877178-1483-4d18-a57a-04b6dba1f392 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:04.137431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 145/294] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:03 2022] GET /identity/v3/role_assignments?user.id=146b0df3ff24493ab0c73101864e8bf4&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=47bff6418933442081338f0ba924ff4a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:05.049031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf100-3f4b-4c14-9a07-ae89085bf00d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.049606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf100-3f4b-4c14-9a07-ae89085bf00d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.049606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf100-3f4b-4c14-9a07-ae89085bf00d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.051253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 150/295] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:05.057523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.057943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.058112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.076008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:05.077211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:05.152635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 146/296] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:05.175209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf100-3f4b-4c14-9a07-ae89085bf00d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.279837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf100-3f4b-4c14-9a07-ae89085bf00d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:05.314452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:05.315178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.315464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.315745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.326102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:05.334339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:05.335304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:05.336072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:05.340204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 151/297] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:05.342571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.449205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775c7f0-00c8-4d4e-b25b-c6748167758f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:05.485806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:05.486475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.486758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.487030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.487775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:05.488080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:05.489451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7960f3-c665-44a4-953a-7c7ac8d37597 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:05.498171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 147/298] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:05.503892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.605244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54c19-efcb-433a-91cb-9b0dc381ecac None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:05.635130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09079-7f87-4626-ac30-e65b2db9ecf6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.635417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09079-7f87-4626-ac30-e65b2db9ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.635851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09079-7f87-4626-ac30-e65b2db9ecf6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.637774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 148/299] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:05.638912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d76e5-d205-4e8a-97a1-d24f198dd3bf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.639201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d76e5-d205-4e8a-97a1-d24f198dd3bf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.639478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d76e5-d205-4e8a-97a1-d24f198dd3bf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.640452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:05.640682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 149/300] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:05.641703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.642154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.642612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] PATH_INFO: `/v3/users/06995ab442c84f28a6f002a53d6bc4b2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.643977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] RBAC: Authorizing `identity:get_user(user_id=06995ab442c84f28a6f002a53d6bc4b2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:05.645635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3d884-babf-4c2d-b522-aae815786e88 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:05.645738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.646066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.646352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.648341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 152/301] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:05 2022] GET /identity/v3/users/06995ab442c84f28a6f002a53d6bc4b2 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:05.649864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.650320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.650763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.663923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:05.665084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:05.670355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:05.671733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:05.730294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 150/302] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:05.732243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.744230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 153/303] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:05.752801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.853841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a577b-5416-4434-82f9-ca3e5d50cb20 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:05.855524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374659-4035-4b1c-a1c4-5eb226de6677 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:05.890039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:05.890232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:05.890861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.891089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:05.891183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.891376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:05.891472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.891656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] PATH_INFO: `/v3/system/users/06995ab442c84f28a6f002a53d6bc4b2/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:05.892544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:05.893114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=06995ab442c84f28a6f002a53d6bc4b2, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:05.894033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:05.894517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:05.900828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 154/304] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:05.900828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:05.917831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 151/305] 10.222.0.44 () {58 vars in 1334 bytes} [Wed May 11 05:44:05 2022] PUT /identity/v3/system/users/06995ab442c84f28a6f002a53d6bc4b2/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:05.917831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.010504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb561-2ff1-4e22-b87d-bc86d96b0b85 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.051070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.051944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.052746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.054060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.060148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3d73-b38d-4ae2-bc2c-42284147fc9d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.065895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:06.074819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:06.075762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:06.076697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 155/306] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:06.083378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.097534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.098268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.098561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.098840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] PATH_INFO: `/v3/groups` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.099769 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.101320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197008e4-3ac9-4529-9c37-48992d954db3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.120509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 152/307] 10.222.0.44 () {60 vars in 1134 bytes} [Wed May 11 05:44:05 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:06.202761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bd7d-6e2c-401f-9036-ac65c760bada None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.215924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2880c0b-307d-4308-bfff-734e75a8a219 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.216213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2880c0b-307d-4308-bfff-734e75a8a219 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.216497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2880c0b-307d-4308-bfff-734e75a8a219 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.217964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 153/308] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:06.224959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.225271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.225543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.241513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.242548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.242749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:06.243216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.243743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.243930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:06.244917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:06.245439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.247210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.257560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 156/309] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:06.266581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.319235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 154/310] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:06.341898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.371525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eda91-5787-440b-b489-e069f59d0475 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.406050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.407094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.407380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.407658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] PATH_INFO: `/v3/users/d444d1ea947b4fc69acbf3c9413ef5de` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.426110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] RBAC: Authorizing `identity:get_user(user_id=d444d1ea947b4fc69acbf3c9413ef5de)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.428055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.430192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 157/311] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/users/d444d1ea947b4fc69acbf3c9413ef5de => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:06.435751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.456863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824430d-f67a-42c3-a68b-b972dbff81f0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.492067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.493267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.493777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.494286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.505277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:06.514936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:06.515854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:06.516616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:06.524279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 155/312] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:06.525502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.535151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bd15-e4b3-41b8-be53-197fd45b8580 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.569964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.570624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.570904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.571179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.572004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, user.id=d444d1ea947b4fc69acbf3c9413ef5de, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:06.572315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.573772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.585931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 158/313] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/role_assignments?user.id=d444d1ea947b4fc69acbf3c9413ef5de&scope.system=all&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:06.634828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de3fd-98a8-4266-b5c2-97be0256b30c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.673574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.674630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.675116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.675591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.676591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:06.677102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.679328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.693511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 156/314] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:06.695113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.802059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003daa0-5df3-4824-97a5-a793a6742433 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.836539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.837419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.837727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.838005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] PATH_INFO: `/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:06.839205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] RBAC: Authorizing `identity:get_user(user_id=fbbfc538dc1f4e2a9b1c8cf3f82472b2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:06.840634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:06.842576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 159/315] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/users/fbbfc538dc1f4e2a9b1c8cf3f82472b2 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:06.847981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:06.946967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923690-14b8-4c06-8063-54b12528955b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:06.981108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:06.982153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:06.982615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:06.983065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:07.050931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:07.052749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:07.154885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 157/316] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:07.156938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:07.257386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66d66-134e-4395-927c-025db857b7de None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:07.291411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:07.292273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:07.292553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:07.292827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:07.294040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:07.295476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cbe0b-66e7-4da3-99ad-671d56b31e25 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:07.297502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 160/317] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:07 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:07.303323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:07.405357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dedc5-0213-40ad-bb5b-9e2c57c5d5dd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:07.439940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:07.440598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:07.440882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:07.441158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:07.442026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, scope.project.id=41742feaebcc43479162462065f1cca1, user.id=fbbfc538dc1f4e2a9b1c8cf3f82472b2) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:07.442338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:07.443921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841f540-7337-4cb0-a9db-2aa120e383fc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:07.453593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 158/318] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:07 2022] GET /identity/v3/role_assignments?user.id=fbbfc538dc1f4e2a9b1c8cf3f82472b2&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:08.278303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4bbc-bf2d-43b7-b5d6-c36c24a2af35 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.278816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4bbc-bf2d-43b7-b5d6-c36c24a2af35 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.278925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4bbc-bf2d-43b7-b5d6-c36c24a2af35 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.280217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 161/319] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:08.285783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452396-0abd-4950-b462-431f55554416 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.286174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452396-0abd-4950-b462-431f55554416 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.286332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452396-0abd-4950-b462-431f55554416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.303980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-47452396-0abd-4950-b462-431f55554416 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:08.305420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-47452396-0abd-4950-b462-431f55554416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:08.371246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 159/320] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:08.394325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d4bbc-bf2d-43b7-b5d6-c36c24a2af35 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.441663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958d66-d67a-4906-b194-7446c3e7daca None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.441955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958d66-d67a-4906-b194-7446c3e7daca None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.442145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958d66-d67a-4906-b194-7446c3e7daca None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.443790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 160/321] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:08.448783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.449071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.449349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.465924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:08.467095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:08.496714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d4bbc-bf2d-43b7-b5d6-c36c24a2af35 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.530871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:08.531676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.531960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.532237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.541753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 161/322] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:08.542801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:08.550530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:08.551393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:08.552851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 162/323] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:08.555231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.558063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.654496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7ea3-ba0d-4f2d-baa9-f8431c60c296 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.654745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca27a-5213-43f5-a386-fc6bd2a3c896 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.690870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:08.691727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.691947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.692226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.694037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:08.694515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:08.695350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.695495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:08.695910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.696324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.697116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 162/324] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:08.697346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:08.697816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:08.699356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:08.702530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.708234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 163/325] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:08.713745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.798604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec9c9c-abb3-467a-bd1d-539b17c57ced None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.814004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc64d5-eebf-4e03-a74b-ea889c10d0f1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.833431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:08.834344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.834629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.834909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] PATH_INFO: `/v3/groups` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.835597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:08.837036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313e6e-fe74-421e-85cd-5af8f3b62a75 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:08.849062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:08.850049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.850330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.850452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 163/326] 10.222.0.44 () {60 vars in 1134 bytes} [Wed May 11 05:44:08 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:44:08.850628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] PATH_INFO: `/v3/users/06995ab442c84f28a6f002a53d6bc4b2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.851834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=06995ab442c84f28a6f002a53d6bc4b2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:08.853270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:08.854941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04030b-f081-4d50-80f8-10c9452d50b5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.860007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04030b-f081-4d50-80f8-10c9452d50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.860107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 164/327] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/users/06995ab442c84f28a6f002a53d6bc4b2 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:08.860192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04030b-f081-4d50-80f8-10c9452d50b5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.860192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 164/328] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:08.861915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:08.862397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:08.862758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:08.863047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:08.881183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:08.882668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:08.953622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 165/329] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:08.967661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696be5f-3d45-437d-bc69-94f3fa67a8d1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:08.975114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:09.010951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:09.011649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:09.012191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:09.012470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:09.013314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] RBAC: Adding query filter params (role.id=47bff6418933442081338f0ba924ff4a, user.id=06995ab442c84f28a6f002a53d6bc4b2, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:09.013652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:09.015125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:09.029736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 165/330] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/role_assignments?user.id=06995ab442c84f28a6f002a53d6bc4b2&scope.system=all&role.id=47bff6418933442081338f0ba924ff4a => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:09.082644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee153e-8eb0-4410-bb10-3111d9e67031 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:09.119934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:09.120745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:09.121023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:09.121295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:09.134483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:09.142571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:09.143727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:09.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 166/331] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:09.150667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:09.262620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde66d4-ce48-4c50-923f-1e5226bcc9fc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:09.296779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:09.297449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:09.297763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:09.298046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:09.298795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:09.299120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:09.300538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:09.309598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 166/332] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:09.315084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:09.418618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145850-6d9c-45a0-b7bf-04146bf3fcef None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:09.452620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:09.453519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:09.453856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:09.454087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] PATH_INFO: `/v3/users/d444d1ea947b4fc69acbf3c9413ef5de` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:09.455303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] RBAC: Authorizing `identity:get_user(user_id=d444d1ea947b4fc69acbf3c9413ef5de)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:09.456767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d5c0-298c-403b-a57d-fb86b9e84579 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:09.458905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 167/333] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:09 2022] GET /identity/v3/users/d444d1ea947b4fc69acbf3c9413ef5de => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:09.464848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:09.574350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec665e7-b087-43c2-bf3e-55b59bd3e8e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:09.608752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:09.609945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:09.610439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:09.610901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] PATH_INFO: `/v3/system/users/d444d1ea947b4fc69acbf3c9413ef5de/roles/10804984d16a4a90a036c9b94ff1eae1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:09.612519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d444d1ea947b4fc69acbf3c9413ef5de, role_id=10804984d16a4a90a036c9b94ff1eae1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:09.614079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141295-802d-456e-a3dc-7f4710aaf5ed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:09.625673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 167/334] 10.222.0.44 () {58 vars in 1334 bytes} [Wed May 11 05:44:09 2022] PUT /identity/v3/system/users/d444d1ea947b4fc69acbf3c9413ef5de/roles/10804984d16a4a90a036c9b94ff1eae1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:11.735071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c6a-d4ed-4e62-8f84-52241fd79f48 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:11.735582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c6a-d4ed-4e62-8f84-52241fd79f48 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:11.735582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c6a-d4ed-4e62-8f84-52241fd79f48 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:11.737138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 168/335] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:11.742333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2a09-324c-4828-aef9-3676a26bc761 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:11.742782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2a09-324c-4828-aef9-3676a26bc761 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:11.742949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2a09-324c-4828-aef9-3676a26bc761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:11.763104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-666d2a09-324c-4828-aef9-3676a26bc761 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:11.764297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-666d2a09-324c-4828-aef9-3676a26bc761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:11.847727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 168/336] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:11.874044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c47c6a-d4ed-4e62-8f84-52241fd79f48 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:11.904824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3aaa-d205-4bbc-b44b-cbd0c18137a7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:11.905139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3aaa-d205-4bbc-b44b-cbd0c18137a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:11.905381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3aaa-d205-4bbc-b44b-cbd0c18137a7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:11.906871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 169/337] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:11.915694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:11.915994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:11.916249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:11.943261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:11.944490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:12.071109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c47c6a-d4ed-4e62-8f84-52241fd79f48 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.089255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 170/338] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:12.121210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.125495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.126432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.126962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.127444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.151401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:12.165499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:12.166437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:12.167218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:12.169776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 169/339] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:12.189512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.232798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3845-ec36-491e-bc83-e94dcb01e80a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.274950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.275753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.276041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.276322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.288671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:12.298107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:12.298997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:12.300209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 171/340] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:12.306312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.361753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd12282-7caf-471a-88b8-6d4521d52e31 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.430753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd90e-0a38-4f42-ac18-447aa37b4d04 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.446453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.447502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.447993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.448538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.449601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:12.450137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:12.451888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:12.467905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.468628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.468916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.469195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.469987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:12.470300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:12.471682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:12.476590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 170/341] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:12.480943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 172/342] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:12.481970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.495938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.616228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aacb0-c71b-4855-9006-66f364960224 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.651040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.651859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.652153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.652438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.663017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb795a7-999c-42ef-a5be-a8a0f5b02ec3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.706264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.707282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.707768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.708853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.721967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:12.723441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76d960-1b46-4edc-aac8-7766326dc29d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:12.783502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:12.785616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4988-1a2e-4678-af26-4cb01a347b81 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:12.825499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 173/343] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:12.829997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962571-7ba9-4de9-aa50-769d318b8429 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.830291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962571-7ba9-4de9-aa50-769d318b8429 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.830569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962571-7ba9-4de9-aa50-769d318b8429 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.832063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 174/344] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:12.833077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb4ef-039c-4a7c-9395-323fbfc32703 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.833929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb4ef-039c-4a7c-9395-323fbfc32703 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.834578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb4ef-039c-4a7c-9395-323fbfc32703 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.835567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 175/345] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:12.838124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bb4ef-039c-4a7c-9395-323fbfc32703 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:12.895424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 171/346] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:12.898093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.898593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.899068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.918864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:12.920432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:12.944818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bb4ef-039c-4a7c-9395-323fbfc32703 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:12.982264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:12.983164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.983449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.983722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:12.985759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:12.987253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cc5a8-7d66-40d0-b911-4e377d84f1f3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:12.989052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 176/347] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:12 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:12.991846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:12.991846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:12.992831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.019685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 172/348] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:13.019685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.021745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:13.023147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:13.121448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 177/349] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:13.122864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.176553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23165-7abb-47e0-87cd-a377959ced9d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.212004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.212876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.213159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.213435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.214732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.216206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.218328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 173/350] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.219154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.249294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4232-f0cc-4293-9c2d-c71c3e546383 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.289778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.290776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.291062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.291337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.302905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.304052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.306509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 178/351] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.307301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.346780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e372f-6bd8-4e94-ad13-63e0c2f16ad8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.389275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.390173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.390456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.390726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.406161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:13.417149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:13.418145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:13.418931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:13.420775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 174/352] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:13.420775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.444394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab0c7-759d-4e22-845c-177c3aa39d3d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.482966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.483818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.484155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.484436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.498319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:13.506434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:13.508637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 179/353] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:13.510592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.543307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf741a-def1-4120-a388-71a0280c6e58 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.590435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.591341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.591628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.591913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.593128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.594695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.596336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 175/354] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.597172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.641177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c75-f939-4256-b73d-321eb49eea69 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.678955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799db459-029b-451b-8778-901916ea9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.679620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db459-029b-451b-8778-901916ea9be7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.679909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db459-029b-451b-8778-901916ea9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.680188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db459-029b-451b-8778-901916ea9be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.681017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799db459-029b-451b-8778-901916ea9be7 None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=04920a235511475bb804bcf2603bb3dd) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:13.681745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799db459-029b-451b-8778-901916ea9be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.682820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799db459-029b-451b-8778-901916ea9be7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.689265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 180/355] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=47bff6418933442081338f0ba924ff4a => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.690313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799db459-029b-451b-8778-901916ea9be7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.714752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486c9ef-f7bc-48a7-b922-ce3849671740 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.752347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.753066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.753350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.753666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.754448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:13.754760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.756822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c11bd-5f6e-4a41-a885-a4bd895e3648 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.766835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 176/356] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.769534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f69ed-1349-43aa-a9a3-492594289cce None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.769534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f69ed-1349-43aa-a9a3-492594289cce None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.769534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f69ed-1349-43aa-a9a3-492594289cce None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.769949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 177/357] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:13.772390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bc5c-11dc-4b99-8fc1-cced9ea9ee53 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.772390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bc5c-11dc-4b99-8fc1-cced9ea9ee53 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.772390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bc5c-11dc-4b99-8fc1-cced9ea9ee53 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.777416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 178/358] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:13.778351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2bc5c-11dc-4b99-8fc1-cced9ea9ee53 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.838944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799db459-029b-451b-8778-901916ea9be7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.885215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.887026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.887798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.888294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.889414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:13.890213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.891782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.896953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2bc5c-11dc-4b99-8fc1-cced9ea9ee53 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:13.904780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 181/359] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.905290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:13.946082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:13.947042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.947330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.947608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.948541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=04920a235511475bb804bcf2603bb3dd) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:13.948861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:13.950352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0543-8f56-4784-a8eb-3a15ff4a2caf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:13.957501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 179/360] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:13.959587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b28d7-1a88-440c-98d8-be2058911fe2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:13.959880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b28d7-1a88-440c-98d8-be2058911fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:13.960164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b28d7-1a88-440c-98d8-be2058911fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:13.981464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b04b28d7-1a88-440c-98d8-be2058911fe2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:13.982831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b04b28d7-1a88-440c-98d8-be2058911fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:14.049886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45d09e-6c31-4929-8e38-87c6f0082898 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.074614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 180/361] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:14.076837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.077360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.078182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.088518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.089232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.089551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.089834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.099720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:14.101938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:14.170673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.173798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.195107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 181/362] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:14.200729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.305925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 182/363] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:14.306866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.313923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93fefd-040f-4c85-9346-c42a1013217d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.356145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.357333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.357752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.358049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] PATH_INFO: `/v3/users/d444d1ea947b4fc69acbf3c9413ef5de` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.359412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] RBAC: Authorizing `identity:get_user(user_id=d444d1ea947b4fc69acbf3c9413ef5de)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.360895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.362565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 182/364] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/users/d444d1ea947b4fc69acbf3c9413ef5de => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:14.363326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.431185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878cc3a-22c2-4131-893f-347a125ac0ed None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.476466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.477411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828fcb-5149-4683-8fdd-86807a42ff22 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.477831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.478262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.478689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.492067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:14.502362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:14.503483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:14.504481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:14.507182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 183/365] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:14.508002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.525223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.526089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.526373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.526649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.542490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:14.553615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:14.554569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:14.555336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 183/366] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:14.556577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.627207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d3f6f-d416-4a19-aafe-7709b364b6c6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.669751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.671324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.671806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.672247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.673839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.675497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.675628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214469-5453-4308-879f-5d99ca993d43 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.677970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 184/367] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:14.680392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.727754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.728415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.728699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.728990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.730489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] RBAC: Adding query filter params (role.id=10804984d16a4a90a036c9b94ff1eae1, user.id=d444d1ea947b4fc69acbf3c9413ef5de, scope.system=all) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:14.730808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.732423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.747827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 184/368] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/role_assignments?user.id=d444d1ea947b4fc69acbf3c9413ef5de&scope.system=all&role.id=10804984d16a4a90a036c9b94ff1eae1 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:14.750270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.799020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa30b-f827-4a26-982a-6df2a010a448 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.837524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.838497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.838701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.839115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.839975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:14.840387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.841946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.852242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 185/369] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:14.853336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.862576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7399195-a832-4c8f-82e9-fd57f7edc6ec None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.899290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.900786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:14.901276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:14.901799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:14.902759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:14.903281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:14.904913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:14.914728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 185/370] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:14.915919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:14.962507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57285c4c-5741-463f-a0b3-931e81d26454 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:14.998580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:14.999504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.000186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.000381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.001573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.003031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.004979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 186/371] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.007149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.031183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972f6b-31b1-4cc6-b62a-d13e9f476bec None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.066988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.068257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.068842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.069334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.115422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77fe18-804b-4245-aa13-a8e36cf8fd69 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.142932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.144867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.157726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.159223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.160006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.160508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.259008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.261498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.278645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 186/372] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:15.279655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.392851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 187/373] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:15.393957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.401980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325468bf-de5c-4626-9e26-1947f048e6b1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.447967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.449053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.449337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.449678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.450512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=41742feaebcc43479162462065f1cca1) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:15.451184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.453221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.459657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 187/374] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=47bff6418933442081338f0ba924ff4a => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.460669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.531654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cf3-ced8-4ee3-8bb9-fb640910e163 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.591483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.592378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.592669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.592954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] PATH_INFO: `/v3/projects/092ac42400414e84802b398999ca7422` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.595787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] RBAC: Authorizing `identity:get_project(project_id=092ac42400414e84802b398999ca7422)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.597305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.599439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 188/375] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/projects/092ac42400414e84802b398999ca7422 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.604838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.615835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc195-e456-4ae9-bdc0-61d4ebd5b4fe None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.695005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.695799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.696086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.696367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.697943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.699420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.701172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 188/376] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.707793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.783298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5f187-9a02-416d-b34a-b7b78014692f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.821242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.822163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.822453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.822736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] PATH_INFO: `/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.830950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] RBAC: Authorizing `identity:get_group(group_id=efe8b90f1d69411fb2d47f05f8fa902e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.832418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.836202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 189/377] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.844876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.856684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef9ef-6b2a-422a-b10f-a5015f75e888 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:15.903145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:15.904399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:15.904688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:15.905284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:15.906695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:15.908685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:15.911044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 189/378] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:15.918884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:15.970869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48961-1aa1-4223-b9fc-05d7782a9940 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:16.010457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:16.011148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.011440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.011979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.012837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] RBAC: Adding query filter params (group.id=efe8b90f1d69411fb2d47f05f8fa902e, role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=092ac42400414e84802b398999ca7422) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:16.013159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:16.014882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d332-b1ce-4a41-8683-df271bdfb580 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:16.022272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 190/379] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/role_assignments?group.id=efe8b90f1d69411fb2d47f05f8fa902e&scope.project.id=092ac42400414e84802b398999ca7422&role.id=9086c2b2021041caa06abc9556a262a5 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:16.132836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7476f-4cf2-45f5-9b1e-0909f7035441 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:16.184579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:16.184579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.184579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.184916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.185604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=41742feaebcc43479162462065f1cca1) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:16.185920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:16.187779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a35d2-2af5-48e0-aeb7-56528a61d1a6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:16.198610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 190/380] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:15 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:16.617524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280486-977e-4ea9-a0c3-4b1f7f04ed10 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.619520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280486-977e-4ea9-a0c3-4b1f7f04ed10 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.619520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280486-977e-4ea9-a0c3-4b1f7f04ed10 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.619520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 191/381] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:16.625919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4540b-e08a-433a-b045-78baf7f61a0b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.626459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4540b-e08a-433a-b045-78baf7f61a0b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.626877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4540b-e08a-433a-b045-78baf7f61a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.645371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7bb4540b-e08a-433a-b045-78baf7f61a0b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:16.647319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7bb4540b-e08a-433a-b045-78baf7f61a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:16.727753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 191/382] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:16.763972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280486-977e-4ea9-a0c3-4b1f7f04ed10 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:16.804964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308aed-0fe7-4fb0-964e-67de62e53f2b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.805271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308aed-0fe7-4fb0-964e-67de62e53f2b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.805537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308aed-0fe7-4fb0-964e-67de62e53f2b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.807046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 192/383] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:16.812236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.812519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.812793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:16.834962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:16.836174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:16.913594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280486-977e-4ea9-a0c3-4b1f7f04ed10 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:16.928361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 193/384] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:16.951822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:16.982392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:16.983436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:16.983891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:16.984319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.012128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:17.020171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:17.021810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:17.022620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:17.036317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 192/385] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:17.041561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.111578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dafd62-71e5-4ff6-9f61-418dc6d936c1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.156289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.157377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.157843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.158274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.177982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:17.186938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:17.187846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:17.188618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:17.197880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 194/386] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:17.204598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.250436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518726f-414c-450f-83c1-7e2c5df28d72 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.321256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23fe0-8aa5-47e1-9f2e-7ee7a9d59169 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.331529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.332212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.332496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.332772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.334199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:17.334550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.335891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.345501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 193/387] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:17.351196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.384180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.384854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.385128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.385410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.386177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:17.386480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.388098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.398926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 195/388] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:17.404596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.533035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0bc64-2743-4de7-a21a-8bff44ac3589 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.539089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabb9e-beaa-4e21-9c73-c8dbbd4397da None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.575934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.576795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.577079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.577355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.578565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.579992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.582037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 196/389] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:17.588623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.596055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.596924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.597210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.597541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.598760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.600230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.602207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 194/390] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:17.610447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.758841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbdef8-b18b-4410-a174-2bafb129682e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.768385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8642c-5888-486a-8967-664673f94b1d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.802875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.803302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.803588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.803873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.806224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.806344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.807209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.807654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.807764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.808171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.809554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.809747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 197/391] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:17.811267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.815262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.818352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 195/392] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:17 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:17.819348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:17.921167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484edbd-77d9-4ebd-b873-bbbb41b0351c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:17.959096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:17.961582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:17.962038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:17.962458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:17.966112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, group_id=92caa20fb10c4b0e86b04d6249b03b0d, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:17.967880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f88fc-44d5-4d5e-be20-1834321a9b62 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:17.994121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 196/393] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 11 05:44:17 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:17.997247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581128-6ef8-47bf-93bf-288aab6b2bf8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:18.050343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:18.051589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:18.052540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:18.053017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:18.055568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=04920a235511475bb804bcf2603bb3dd, group_id=92caa20fb10c4b0e86b04d6249b03b0d, role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:18.057241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8494eec-a92b-4e60-9e49-f1c5500951e5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:18.085851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 198/394] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 11 05:44:17 2022] PUT /identity/v3/projects/04920a235511475bb804bcf2603bb3dd/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:18.472620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada001-38a2-4147-a4d9-e8a2c1eab822 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:18.473044 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada001-38a2-4147-a4d9-e8a2c1eab822 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:18.473438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada001-38a2-4147-a4d9-e8a2c1eab822 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:18.476464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 197/395] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:18.482890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:18.483182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:18.483467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:18.502651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:18.503863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:18.580852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 199/396] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:18.607965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ada001-38a2-4147-a4d9-e8a2c1eab822 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:18.722512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ada001-38a2-4147-a4d9-e8a2c1eab822 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:18.759721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:18.760695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:18.760990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:18.761273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:18.773378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:18.781080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:18.781973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:18.782743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:18.787788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 198/397] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:18.789158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:18.897588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba0b9-7a2f-446b-8500-833e1f695283 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:18.941368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:18.942121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:18.942428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:18.943245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:18.944014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:18.944321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:18.945784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8135e-4c29-4d4d-94ae-897f599fa6c3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:18.961043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 200/398] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:18.966720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.121546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757fcd-6b48-4248-a8aa-da4a4f5660b7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.142084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5656-ff43-4fc2-97b4-40d2cf2768ee None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.142785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5656-ff43-4fc2-97b4-40d2cf2768ee None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.142785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5656-ff43-4fc2-97b4-40d2cf2768ee None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.144230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 201/399] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:19.149668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad339a-56d4-4d57-aa46-7b0a3eab1947 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.149959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad339a-56d4-4d57-aa46-7b0a3eab1947 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.150237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad339a-56d4-4d57-aa46-7b0a3eab1947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.165375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.166446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.166729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.167015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.168220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:19.169717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:19.175790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 199/400] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:18 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:19.177172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.210524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c1ad339a-56d4-4d57-aa46-7b0a3eab1947 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:19.211719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c1ad339a-56d4-4d57-aa46-7b0a3eab1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:19.303429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd501b9-edc2-4d9c-8c3b-07c260d333b8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.326581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 202/401] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:19.328068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193025-ae19-494e-b489-9aad2176ede5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.328363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193025-ae19-494e-b489-9aad2176ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.328644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193025-ae19-494e-b489-9aad2176ede5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.329942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 203/402] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:19.336277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.336565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.336850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.354645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:19.355868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:19.361016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.361910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.362204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.362487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.363809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:19.365462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:19.367610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 200/403] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:19.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.431648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 204/404] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:19.432779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.495807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c0c7-38a6-4208-b508-84e080d275e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.533266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.533924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931617d-adc7-423d-8b64-ac483b0b9615 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.534109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.534377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.534657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.545101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:19.554079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:19.554940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:19.555716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 201/405] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:19.557032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.573324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.574500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.574920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.575329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.577460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, group_id=92caa20fb10c4b0e86b04d6249b03b0d, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:19.579133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:19.596702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 205/406] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 11 05:44:19 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:19.597836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.714561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce119c-1653-4a47-9865-41f72aa88de6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.754653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.756381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.756846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.757263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.770292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:19.780199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:19.781326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:19.782209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:19.784527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 202/407] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:19.791267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.839532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09315083-3d43-4cd5-bd90-a11d3e783f3e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.876966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.877976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.878396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.878833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.879720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:19.880712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:19.882438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:19.891730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 206/408] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:19.898455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:19.912017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eef71-bc67-4165-82dc-f3deb49ab35d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:19.952056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:19.952763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:19.953051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:19.953335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:19.954503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:19.954820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:19.956660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:19.967584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 203/409] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:19.974336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:20.033421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376b43-7b97-4967-a6f9-e803973c9436 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.072397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.073774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.074264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.074761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] PATH_INFO: `/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.076176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] RBAC: Authorizing `identity:get_group(group_id=efe8b90f1d69411fb2d47f05f8fa902e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.077926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.080054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 207/410] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:20.089495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:20.118030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307edb6-b87d-4ed2-b4dc-058bff6d57db None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.202254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.203151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.203432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.203708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.204989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.206497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.208967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 204/411] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:19 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:20.214723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:20.232465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6fb3f-09cc-4442-907f-6f20860a9e8c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.267271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.268195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.268487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.268764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] PATH_INFO: `/v3/projects/092ac42400414e84802b398999ca7422` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.270037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] RBAC: Authorizing `identity:get_project(project_id=092ac42400414e84802b398999ca7422)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.272215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.274380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 208/412] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:20 2022] GET /identity/v3/projects/092ac42400414e84802b398999ca7422 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:20.282375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:20.411783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5b167-1561-427c-beaa-289ebe346ece None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.455416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc011-d17c-4c21-8662-b84472582b27 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.472419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.473713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.474449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.475007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.476426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.478099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.480306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 205/413] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:20 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:20.485954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:20.528890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.529816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.530102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.530383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] PATH_INFO: `/v3/projects/092ac42400414e84802b398999ca7422/groups/efe8b90f1d69411fb2d47f05f8fa902e/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.532376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] RBAC: Authorizing `identity:create_grant(project_id=092ac42400414e84802b398999ca7422, group_id=efe8b90f1d69411fb2d47f05f8fa902e, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.533849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfacb-5a86-4ba3-9edb-b8424d8f2671 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.548868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 209/414] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 11 05:44:20 2022] PUT /identity/v3/projects/092ac42400414e84802b398999ca7422/groups/efe8b90f1d69411fb2d47f05f8fa902e/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:20.647571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959bc9-d908-4793-a15a-4c36e7710eef None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:20.697954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:20.698858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.699140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.699419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.701766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] RBAC: Authorizing `identity:create_grant(project_id=41742feaebcc43479162462065f1cca1, group_id=92caa20fb10c4b0e86b04d6249b03b0d, role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:20.703229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7ee9-8914-44a7-8af5-df6682225220 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:20.732964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 206/415] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 11 05:44:20 2022] PUT /identity/v3/projects/41742feaebcc43479162462065f1cca1/groups/92caa20fb10c4b0e86b04d6249b03b0d/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:44:20.845633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38c0c-418f-4855-92de-eaa3c439966c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.845925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38c0c-418f-4855-92de-eaa3c439966c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.846129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38c0c-418f-4855-92de-eaa3c439966c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.847620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 210/416] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:20.854183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:20.854568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:20.854750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:20.874199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:20.875409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:20.948838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 207/417] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:20.972808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38c0c-418f-4855-92de-eaa3c439966c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.077702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38c0c-418f-4855-92de-eaa3c439966c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:21.116677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:21.117404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.117714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.117990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.128725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-6b742f33-54a7-4924-8b6a-880d90e933e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:21.137177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:21.138106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:21.140395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 211/418] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:21.147315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.269903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a4d99-8a65-4394-9067-ac7d7a824073 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:21.312511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:21.313191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.313496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.313791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.314548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:21.314860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:21.316236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:21.322993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b55-17b8-4b06-9b08-9dfeafcf7f56 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.323461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b55-17b8-4b06-9b08-9dfeafcf7f56 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.323604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe33b55-17b8-4b06-9b08-9dfeafcf7f56 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.325043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 212/419] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:21.333045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 208/420] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:21.336586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.336871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.337143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.342281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.357554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:21.358816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:21.459409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 213/421] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:21.482531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.493854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad192e48-1a70-4377-9acb-a7fcc73bafd0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:21.531488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:21.532200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.532484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.532762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.641501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:21.642137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:21.686530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16440a-5eb1-4ab1-af20-0b4bed094092 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:21.721231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:21.721990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.722272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.722545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.733210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:21.743235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:21.744124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:21.744975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 214/422] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:21.753619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.846229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 209/423] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:21.852008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.855707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe8f7-90c1-4f5b-a0a8-8675a38f2d57 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:21.893599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:21.893599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:21.893599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:21.893599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:21.893997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:21.893997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:21.894939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:21.907541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 215/424] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:21.914499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:21.975981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e4d91-c37b-4b21-8b63-c09735ee302f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.023059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.024265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.024758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.025262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.027422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8453a-fb2f-4763-86b4-e269b2d73b22 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.028347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.030073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.032262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 210/425] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:22.042349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.061416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.061781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.062123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.062404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.132208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.133711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.151840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49936-1d9b-41b0-b23b-8791919c18c0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.209895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.211249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.211741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.212222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.218379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.220191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.222600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 211/426] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:22.229202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.243167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 216/427] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:22.253548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.365244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1dc5-3de7-4995-9dbc-edffa3bcceb9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.401762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.402620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.402904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.403182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] PATH_INFO: `/v3/projects/04920a235511475bb804bcf2603bb3dd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.404453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] RBAC: Authorizing `identity:get_project(project_id=04920a235511475bb804bcf2603bb3dd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.406027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca94b1-3abd-4f11-89da-4c7fe4ed3a9d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.408091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 217/428] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/projects/04920a235511475bb804bcf2603bb3dd => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:22.409407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8b5-9340-4de5-ba6d-d9e16147fcb6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.409717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8b5-9340-4de5-ba6d-d9e16147fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.409996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8b5-9340-4de5-ba6d-d9e16147fcb6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.411550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 218/429] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:22.414183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e8b5-9340-4de5-ba6d-d9e16147fcb6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.424524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54dbe-33df-4cc8-8bb6-d7e7705e5175 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.468315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.468974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.469261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.469564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.470397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=04920a235511475bb804bcf2603bb3dd) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:22.470714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.472145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3227c-612f-4bd9-999b-a635f3a6d5db None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.478815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 212/430] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=47bff6418933442081338f0ba924ff4a => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:22.480494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.480730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.481178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.534586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:22.535817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:22.543357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e8b5-9340-4de5-ba6d-d9e16147fcb6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.623608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.624570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.624855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.625130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.626615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.628061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.634360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 219/431] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:22.638700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.659561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 213/432] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:22.696427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:22.758855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4367b8-42f1-46c5-a3e0-d0410282a292 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.807220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.808221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.808707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.809152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.810174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=04920a235511475bb804bcf2603bb3dd) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:22.810686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:22.812305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:22.819527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 220/433] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=04920a235511475bb804bcf2603bb3dd&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:22.825394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d742-e9cf-4a27-9838-962115afd318 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:22.867707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:22.868977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:22.869553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:22.870023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:22.883350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:22.892084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:22.893053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 05:44:22.893869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:22.897049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 214/434] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:22.903141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.021018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721c7b-fb46-4f4b-a765-7ef2f740e143 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.059103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.060170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.060661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.061125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.062248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:23.062752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:23.064341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:23.074057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 221/435] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:23.079536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.195744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c76075-02c4-40ac-a865-b7f4bf12a5d5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.233255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.234346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.234822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.235285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.305139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:23.307037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23abb8-be45-4556-9bd8-2cc0b90f0b88 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:23.418171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 215/436] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:23.423871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.493963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823b7f-b5ce-4e8a-9f93-b435d2193330 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.494252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823b7f-b5ce-4e8a-9f93-b435d2193330 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.494532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823b7f-b5ce-4e8a-9f93-b435d2193330 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.495893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 216/437] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:23.500627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74df1-4b22-4222-ac72-b36cb68c761d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.500915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74df1-4b22-4222-ac72-b36cb68c761d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.501188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74df1-4b22-4222-ac72-b36cb68c761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.519841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cae74df1-4b22-4222-ac72-b36cb68c761d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:23.521880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cae74df1-4b22-4222-ac72-b36cb68c761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:23.526608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e4f1-9fdd-474d-9856-cf8b9e2a402a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.559161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.559934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.560215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.560488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.561686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:23.563162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392f75e-4618-44b8-b695-c1bc9d0350a5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:23.565004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 222/438] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:23.565986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be536cf-9558-4067-8419-7afb6f03875d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.566267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be536cf-9558-4067-8419-7afb6f03875d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.566542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be536cf-9558-4067-8419-7afb6f03875d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.568487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 223/439] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:23.570695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be536cf-9558-4067-8419-7afb6f03875d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.588920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 217/440] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:23.590878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.591173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.591458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.610093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:23.611086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:23.667371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be536cf-9558-4067-8419-7afb6f03875d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.674398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 218/441] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:23.675219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.700360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.701210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.701519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.701807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.702973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:23.704405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:23.706036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 224/442] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:23.711348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.768822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22c4b5-44dc-495a-98bc-90cb7513b619 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.801398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.802947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.803236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.803525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.804072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588def6-158b-41b6-aeb4-cd9b3200e656 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.813298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:23.821592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:23.822708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 219/443] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:23.823738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.838317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.839100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.839386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.839661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.849448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:23.857046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:23.857984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:23.858773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 225/444] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:23.859421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.919124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32fef-30bc-4ce6-8e60-ee61d8ca643b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.950099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.950736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.951017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.951295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.952114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=47bff6418933442081338f0ba924ff4a, scope.project.id=41742feaebcc43479162462065f1cca1) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:23.952425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:23.953876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:23.955119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddcbc-bad5-4790-9879-1abb5eab75f9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:23.960035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 220/445] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=47bff6418933442081338f0ba924ff4a => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:23.960802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:23.996237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:23.997252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:23.997579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:23.997863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:23.998632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:23.998949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.000400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.013937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 226/446] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:24.015109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.068547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeb49b-78f2-4b57-af04-372ed680b9f4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.108271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.108959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.109247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.109569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.110342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:24.110654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.112065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.118620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be37a-7a30-4069-abba-fa7835df1ce1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.120783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 221/447] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:24.126436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.159214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.159867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.160156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.160428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.228935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ea8d4-c742-4aab-ba52-bb28e8228090 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.243618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.245095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.265096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.265783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.266073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.266351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.344396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.345799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.354751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 227/448] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:24.360153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.439047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 222/449] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:24.445067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.454749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2e7a-b78c-4f6c-b4c6-8693ac16c1e0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.486748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.487599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.487883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.488159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] PATH_INFO: `/v3/projects/41742feaebcc43479162462065f1cca1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.489334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] RBAC: Authorizing `identity:get_project(project_id=41742feaebcc43479162462065f1cca1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.491011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.492675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 228/450] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/projects/41742feaebcc43479162462065f1cca1 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:24.497977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.538776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e03151-5157-4cc4-b8f0-25cf55e16a2d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.570896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.571754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.572036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.572320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] PATH_INFO: `/v3/projects/092ac42400414e84802b398999ca7422` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.573516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] RBAC: Authorizing `identity:get_project(project_id=092ac42400414e84802b398999ca7422)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.574947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.576615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 223/451] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/projects/092ac42400414e84802b398999ca7422 => generated 344 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:24.581972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.591918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5ee9-f209-4b1b-9685-c3ce34f1049c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.624138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.624906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.625186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.625457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] PATH_INFO: `/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.626656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] RBAC: Authorizing `identity:get_group(group_id=92caa20fb10c4b0e86b04d6249b03b0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.628087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.629752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 229/452] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/groups/92caa20fb10c4b0e86b04d6249b03b0d => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:24.635434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.676166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8524ed-2f00-4837-ba44-f9d9683e3528 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.709887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.710732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.711017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.711295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] PATH_INFO: `/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.712480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] RBAC: Authorizing `identity:get_group(group_id=efe8b90f1d69411fb2d47f05f8fa902e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.713954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.715563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 224/453] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/groups/efe8b90f1d69411fb2d47f05f8fa902e => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:24.721203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:24.728001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48248572-d844-43a1-a149-bfc992d4ae4d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.760163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.760801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.761089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.761364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.762472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] RBAC: Adding query filter params (group.id=92caa20fb10c4b0e86b04d6249b03b0d, role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=41742feaebcc43479162462065f1cca1) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:24.762784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.764208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a77f3-19ad-471d-9a34-133b10a49bd5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.770032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 230/454] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/role_assignments?group.id=92caa20fb10c4b0e86b04d6249b03b0d&scope.project.id=41742feaebcc43479162462065f1cca1&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:24.816888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d8931-486f-4db8-8179-f08b530d1336 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:24.852666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:24.853334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:24.853648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:24.853927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:24.854771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] RBAC: Adding query filter params (group.id=efe8b90f1d69411fb2d47f05f8fa902e, role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=092ac42400414e84802b398999ca7422) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:24.855086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:24.856545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd5acf-442e-413f-ac96-16a98d193e05 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:24.862969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 225/455] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 11 05:44:24 2022] GET /identity/v3/role_assignments?group.id=efe8b90f1d69411fb2d47f05f8fa902e&scope.project.id=092ac42400414e84802b398999ca7422&role.id=9086c2b2021041caa06abc9556a262a5 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:27.764943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2a09-ead3-4d7a-8f0e-b87ca0b952f7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:27.765990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2a09-ead3-4d7a-8f0e-b87ca0b952f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:27.766503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2a09-ead3-4d7a-8f0e-b87ca0b952f7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:27.768290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 231/456] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:27.777268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67a39-9b5a-4352-8e22-7cbd938e7b34 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:27.777268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67a39-9b5a-4352-8e22-7cbd938e7b34 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:27.777268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c67a39-9b5a-4352-8e22-7cbd938e7b34 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:27.778205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 226/457] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:27.779820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:27.780325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:27.780789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:27.789998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:27.790618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:27.791121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:27.805195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:27.806772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:27.819274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:27.820461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:27.883374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 232/458] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:27.910607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:27.965619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 227/459] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:27.990314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.073284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd526-b6c5-4ca6-ae0e-e8467c222474 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.091950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ba189-e6de-40a1-aa24-c2a0d0bc11e3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.112302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.113337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.113792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.114763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.125030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.126649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.127514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.128309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.128662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.128863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.139354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.140805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e53989b8-1b46-412d-818d-8df1e6ca116a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:28.146246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:28.147270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:28.148267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:28.148267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:28.148267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.148267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:28.150102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 233/460] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:28.151471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7362a-2a02-4768-912f-db7eb35e5b78 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.151894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7362a-2a02-4768-912f-db7eb35e5b78 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.152324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7362a-2a02-4768-912f-db7eb35e5b78 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.153915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 234/461] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:28.158282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7362a-2a02-4768-912f-db7eb35e5b78 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d0c48b6f-364c-4674-88d1-2312bf28cfc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:28.163772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:28.164762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:28.165719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:28.165719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:28.165719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.165719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:28.165719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 228/462] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:28.166527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.166814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.167094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.195213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:28.196442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:28.273494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 229/463] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:28.273494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.274431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7362a-2a02-4768-912f-db7eb35e5b78 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.326862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.327740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.328164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.328577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.329431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:28.329921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.331444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.349284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 235/464] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:28.350375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.372182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fa8e-2f0f-4dc2-a8c4-1e00863f4ab2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.408419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.409086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.409373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.409686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.410409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:28.410717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.412720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.423900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 230/465] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:28.424709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.469165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8418a-1456-471a-b10e-45134ef259fe None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.504327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.505457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.505765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.506047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.516033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.517522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.527215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836dc6-77c5-4834-9967-934c13fd65d8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bda4380b-058f-4783-be92-4e2d96e72ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:28.535573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:28.536634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:28.537505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:28.537505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:28.537505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:28.537505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:28.541642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 236/466] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:28.542956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbd64-bbb3-4d7a-b498-926c080d17dc None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.543243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbd64-bbb3-4d7a-b498-926c080d17dc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.543521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbd64-bbb3-4d7a-b498-926c080d17dc None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.544908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 237/467] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:28.545451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbd64-bbb3-4d7a-b498-926c080d17dc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.568746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.569422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.569905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.570189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.571213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.573092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.605624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 231/468] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:28 2022] POST /identity/v3/users => generated 248 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:28.605624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.651242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbd64-bbb3-4d7a-b498-926c080d17dc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.691181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.692005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.692417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.692808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.693849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.695513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e2e1b-8887-4142-b014-5cc972d23fa2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.721781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 238/469] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:28 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:28.723621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.724022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.724356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.734427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25ef5-fb82-40de-af4c-dc6352eaef44 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.748700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:28.750340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:28.774855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.775564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.775924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.776203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.776969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:28.777279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.778877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:28.795055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 232/470] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:28.800959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.833889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 239/471] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:28.882871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:28.931548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f89-f161-4d9c-afcb-00ca221f8ad5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:28.979890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:28.980747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:28.981816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:28.981816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:28.982065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:28.983565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6874308-a3b8-465c-bfa7-64611e7d33fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.013170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 233/472] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:28 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:44:29.019378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff164-615a-4a71-8566-7972a600d90c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.019561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12ee81-16a8-4687-9b8f-52557da76b1c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.019778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff164-615a-4a71-8566-7972a600d90c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.019954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff164-615a-4a71-8566-7972a600d90c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.022496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 234/473] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:29.028076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.028384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.028670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.048912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:29.050970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:29.065214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.066458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.066953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.068500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.083439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:29.086342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:29.111622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:29.112695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:29.113738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:29.113738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:29.113738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:29.113738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:29.117170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 240/474] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:29.125374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:29.150862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 235/475] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:29.195197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:29.284570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653c78-f469-4a23-b2e3-1b2026314b44 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.320034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.320709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.320992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.321267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.322036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:29.322334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:29.324112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.336070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 241/476] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:29.337361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af589-8a36-42c1-95cc-86cb829a5cac None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.341125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:29.382587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.383869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.384349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.384969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.386359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:29.388462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.398325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.sql.core [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 05:44:29.398325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 05:44:29.398325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [parameters: {'id': 'a0d0b095ca87491c9855b8d6144f1a29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 05:44:29.398325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80069) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 11 05:44:29.423636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return ref.to_dict() May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:44:29.424496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application yield resource May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.rollback() May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.force_reraise() May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise self.value May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application session.commit() May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 05:44:29.425430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._prepare_impl() May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.flush() May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._flush(objects) May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application compat.raise_( May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application flush_context.execute() May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rec.execute(self) May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 05:44:29.426299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:44:29.427977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:44:29.428810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [parameters: {'id': 'a0d0b095ca87491c9855b8d6144f1a29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:29.429841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 05:44:29.430807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.434171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 236/477] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 11 05:44:29 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:29.439929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:29.471452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592616-ab38-4290-ac76-f82af152b11e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.509976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.511180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.511583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.512276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.513332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:29.515701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.541258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 242/478] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:29 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:44:29.561149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf1ea-a0b8-449c-a70e-ec8e102fd337 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.601932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.603118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.603585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.604018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.617334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e6c758a6-5f8b-40a5-ad2d-45d90c512fe1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:29.626366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:29.627458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 05:44:29.628440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:29.631664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 237/479] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:29.637359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:29.775420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8c67-e641-4fcf-a268-563890fdf4ee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:29.811376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:29.812048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:29.812330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:29.812606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:29.813356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:29.813696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:29.815084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fef071-d090-4d33-ba54-5eebfc2bc2c0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:29.824249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 243/480] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:31.523223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2da3-e663-42ac-bdf7-f2af2d056108 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:31.523768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2da3-e663-42ac-bdf7-f2af2d056108 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:31.523768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2da3-e663-42ac-bdf7-f2af2d056108 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:31.525643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 238/481] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:31.530646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d0c4-1563-45a3-8b52-342eb92491c2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:31.531071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d0c4-1563-45a3-8b52-342eb92491c2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:31.531393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d0c4-1563-45a3-8b52-342eb92491c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:31.566670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c601d0c4-1563-45a3-8b52-342eb92491c2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:31.568767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c601d0c4-1563-45a3-8b52-342eb92491c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:31.672042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 244/482] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:31.675004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef76d4-af05-4e53-8f47-8f672bae989a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:31.675289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef76d4-af05-4e53-8f47-8f672bae989a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:31.675562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef76d4-af05-4e53-8f47-8f672bae989a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:31.678029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 239/483] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:31.683409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:31.683699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:31.683976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:31.700572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:31.701766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:31.713698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef76d4-af05-4e53-8f47-8f672bae989a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:31.825218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 245/484] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:31.880038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef76d4-af05-4e53-8f47-8f672bae989a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:31.885659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:31.968245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:31.969041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:31.969323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:31.969627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:31.989497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:32.001757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.002662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.003438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:32.007790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 240/485] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:32.015799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.048617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628aa5a-3bcd-4051-b739-897b9fe3e921 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.116546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.117257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.117560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.117834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.146750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-409b1e1b-f052-4007-891b-7bff39f6a3b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:32.154900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.155806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:32.156564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 246/486] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:32.157706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b2cb-9a19-42fa-9662-ad57f8530b25 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.157998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b2cb-9a19-42fa-9662-ad57f8530b25 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.161518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b2cb-9a19-42fa-9662-ad57f8530b25 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.161518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 247/487] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:32.166387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b2cb-9a19-42fa-9662-ad57f8530b25 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.190824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ace0fa-a784-4093-b0a8-9a8075e28a1b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.226227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.226894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.227177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.227456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.228365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:32.228674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.230392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2cbd-b628-46b5-99d8-a8073040d4fd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.245158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 241/488] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:32.245158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.245158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.245158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.263111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:32.264298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:32.293666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b2cb-9a19-42fa-9662-ad57f8530b25 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.331237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.332270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.333341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.333849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.334815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:32.335320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.336912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.346358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 248/489] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:32.347631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.349621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 242/490] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:32.354148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.469109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd10c70-63ad-428f-8749-ed80d551e08a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.472424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19aa5e-dec3-4f3f-af5a-add657b2e211 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.503921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.506166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.506728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.507257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.509323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.510347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.510535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.510810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.519932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.521886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.523673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.525616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:32.542167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.543684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.544798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:32.544798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:32.544798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:32.544798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:32.546759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 243/491] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9738a78b-0ae0-4ec8-85b1-2e8e9fc2ff6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:32.546881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.548787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:32.548787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:32.548787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:32.548787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:32.549940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.552999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 249/492] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:32.554512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7194e0-fd5d-4a93-b2f2-a6a06e373a19 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.554797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7194e0-fd5d-4a93-b2f2-a6a06e373a19 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.555077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7194e0-fd5d-4a93-b2f2-a6a06e373a19 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.557212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 250/493] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:32.557422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7194e0-fd5d-4a93-b2f2-a6a06e373a19 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.659303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c28ae-60c4-4538-8cd7-595d22e8a640 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.660821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7194e0-fd5d-4a93-b2f2-a6a06e373a19 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.693299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.693515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.693984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.694105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.694272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.694420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.694562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.694704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.695238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:32.695545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.696908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.704682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:32.712950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 251/494] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:32.712950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4cac7c58-fdf6-4f18-ae69-763156e810b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:32.713185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.714001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:32.714765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 244/495] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:32.715390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0996-3e8b-4984-82da-49171506d46a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.716040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0996-3e8b-4984-82da-49171506d46a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.716040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0996-3e8b-4984-82da-49171506d46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.735202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-764f0996-3e8b-4984-82da-49171506d46a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:32.736669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-764f0996-3e8b-4984-82da-49171506d46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:32.804120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 245/496] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:32.804951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0996-3e8b-4984-82da-49171506d46a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.812486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08327d-92c6-4979-b434-2f19eaf10d48 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.845254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.845938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.846222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.846497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.847210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:32.847515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.848911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.859695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 252/497] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:32.860467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.898566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0996-3e8b-4984-82da-49171506d46a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.930586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78159123-0320-4a44-b547-88331792b30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.931373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159123-0320-4a44-b547-88331792b30d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.931659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159123-0320-4a44-b547-88331792b30d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.931937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78159123-0320-4a44-b547-88331792b30d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.938752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78159123-0320-4a44-b547-88331792b30d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.940215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78159123-0320-4a44-b547-88331792b30d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:32.953144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69404ea0-6c4f-45f8-8831-365fa9198639 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-78159123-0320-4a44-b547-88331792b30d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:32.957252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:32.958158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:32.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 246/498] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:32.959954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27a6c-99a3-4c2d-8d03-d36f16616d78 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.960171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27a6c-99a3-4c2d-8d03-d36f16616d78 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.960438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27a6c-99a3-4c2d-8d03-d36f16616d78 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.961721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 247/499] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:32.962414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c27a6c-99a3-4c2d-8d03-d36f16616d78 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:32.988716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:32.989857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:32.990145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:32.990418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:32.991147 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:32.991448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:32.992804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.000229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 253/500] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:33.000998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.059552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c27a6c-99a3-4c2d-8d03-d36f16616d78 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.091739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.092520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.092808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.093090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.093217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065901b0-f4fb-4d36-8635-fcc07ceb1abd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.103548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:33.111263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:33.112093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:33.112878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 248/501] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:33.113530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.129140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.130093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.130251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.130522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.138070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.139487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fe523b74-9c0f-4eca-8709-b2e590081ab7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:33.154794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:33.155645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:33.156543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 254/502] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:33.157090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.157379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.157698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.173975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:33.175149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:33.213684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9ab7-6963-4ac0-a32c-54fd7729c816 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.238202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 255/503] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:33.239143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.245719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.246384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.246675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.246956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.247794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:33.248107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.249599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.286640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 249/504] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:33.290388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.347882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c52de-ca78-483b-b585-1eeafc027a72 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.380896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.381686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.381965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.382234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.384362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11dfe3-fa25-4c37-a681-c53e39934032 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.391872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.393323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:33.410458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:33.411524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 256/505] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:33.412363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.420926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.421625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.421915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.422198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.422947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:33.423307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.424639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.432502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 250/506] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:33.433275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.506715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b14f4-2624-4e45-bffe-a489436e0b73 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.527152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b44319-37ec-422e-b8fc-89f507b336e3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.538930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.539593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.539897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.540175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.541003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:33.541313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.542775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.559211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.559998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.560285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.560567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.571731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.573180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.578766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 257/507] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:33.579614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:33.590919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:33.591979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 251/508] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:33.592960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.678976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60cd58-45c4-4c33-9d75-19d130997187 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.686875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718dac-ac47-4d2a-8398-607687a402a1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.711280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.711920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.712203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.712478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.719217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.719873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.720168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.720445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.721161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:33.721494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.722922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.734045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 252/509] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:33.734837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.776829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.778248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.829362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f968c-42d1-473b-8519-b33a48d5cf72 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.861681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.862469 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.862752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.863027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:33.869376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 258/510] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:33.869376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.873936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:33.875023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:33.892866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:33.893974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 253/511] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:33.894818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:33.965138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8c35-0b0e-48d1-b819-24e402272345 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.988843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be86d6-7d20-4934-b998-eb61f274abf7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:33.998444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:33.999084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:33.999369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:33.999647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.021109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.021770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.022047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.022320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.023090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:34.023331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.024691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.035877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 254/512] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:34.036600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.065233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.066727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.129844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f13304-b6db-421a-97b8-cb85b1087746 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.159356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 259/513] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:34.160405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.162491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.163280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.163570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.163849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.170826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.172283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:34.187050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:34.187958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:34.188809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 255/514] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:34.189352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.258393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828aaa-2335-49a4-bc11-25e62e7682ba None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.282018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597dd8-e54e-4263-acce-deb4cd9dbf88 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.290438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.291162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.291442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.291713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.301125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.303255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.314192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.314835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.315114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.315385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.316091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:34.316396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.317863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:34.320088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:34.320883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:34.321740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:34.321740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:34.321740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:34.321740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:34.325707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 260/515] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:34.326467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.333502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 256/516] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:34.333502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.419822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9127a35-80da-4ff0-8880-887bd11467de None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.421555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78ba30-3d0c-491b-8d08-19b3d4096e56 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.451218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.451873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.452147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.452251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.452418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.452915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.453110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.453198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.453459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.454604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.464051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.465499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.474312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 261/517] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:34 2022] POST /identity/v3/users => generated 247 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:34.475164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:34.483098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:34.484010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:34.484827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:34.484827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:34.484827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:34.484827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:34.487123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 257/518] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:34.487123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.585025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2df9a-7f99-411a-a4ea-bcb62527b217 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.596793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febc27-8a76-47b3-9955-8e455c7e720e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.622398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.623078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.623370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.623642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.624498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:34.624806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.626321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.632128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.632809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.633099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.633375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.634558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:34.635017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.636696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.646678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 262/519] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:34.653814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 258/520] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:34.653814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.654309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.753614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e496-0861-46bb-8d3f-5e30194efb73 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.757161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44b71a-938b-4438-a994-77360fec87f2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.788185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.788860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.789152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.789416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.790156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:34.790473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.791088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.791827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.791932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.792150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.792428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.799606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.801221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.808262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 259/521] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:34.808262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:34.817388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:34.818516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 263/522] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:34.824112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:34.913562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348d6b-a32b-4e10-a64b-9b323d7ff08a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.917398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2220d42-056c-4b1d-90c1-1bef7c939202 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:34.948374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.949030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.949313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.949622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.951045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:34.951892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:34.952243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:34.952582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:34.959805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:34.961337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:34.975542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:34.976590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:34.977663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:34.981811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 264/523] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:34.982958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.016704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.018352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.082383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2556-e0a4-491f-b4c2-c210552009b4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.112963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 260/524] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:35.114940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.117537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.118339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.118628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.118906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.125741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.127191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:35.141863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:35.142857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 265/525] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:35.149224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.216270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332461-82ca-40e0-80e3-5533f31e4c05 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.248112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c24a4-a8c8-4239-9a8f-3e67ba8630d9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.249897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.250579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.250858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.251133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.251974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:35.252288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.253765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.278436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 261/526] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:35.279434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.283474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.283474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.283785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.284004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.284788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:35.285098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.286693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.309029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 266/527] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:35.309029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.383972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77e1a-132d-4464-a829-d8d0b85e05fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.403974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b245f-ee36-40ed-b138-c545b0e56981 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.416642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.417758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.418236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.418700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.429505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.431168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.437027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.437676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.437957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.438232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.439006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:35.439312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.440739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:35.449909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:35.450892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:35.451897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:35.451897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:35.451897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:35.451897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:35.452113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 267/528] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:35.452665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.453871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 262/529] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:35.454792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.555370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20a25-95f7-45f7-8c5d-f85c9fb2ddc6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.561057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d81-c5d2-45b8-bdcd-c8f98296dcd2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.588352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.589000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.589285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.589590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.595055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.595707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.595996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.596278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.597119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=1d7880dd036c4d1a86a80a3f0a1e6bba) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:35.597610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.599365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.605067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 263/530] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/role_assignments?user.id=1d7880dd036c4d1a86a80a3f0a1e6bba&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:35.605955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.669966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.671510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.731295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352de0f-3ab5-4320-b054-e531e46d28ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.767646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:35.768319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:35.768601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:35.768874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:35.769759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:35.770229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:35.771754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:35.778144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 264/531] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:35.779011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.788412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 268/532] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:35.794510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:35.933549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f898-359b-4a85-85a0-7a750f5554dd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:35.947654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2cc67-bf3b-44b4-87e2-3069ceee895e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.003510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.005083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.007319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.007850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.009123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.011139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.013038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.026325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.027443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.027917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.028400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.031215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 265/533] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:36.045499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.045686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.045686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:36.078397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:36.079376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:36.080190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:36.080190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:36.080190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:36.080190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:36.080487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 269/534] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:36.085766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.193991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3f63-b628-4a7e-9c11-60138e038cbf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.231039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.231796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.232148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.232492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.235528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.235528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.235528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.249951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 270/535] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:36.257274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.317039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebac1d-111b-4516-8294-b3116d4dd4cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.375438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b7bb7-2b06-46c8-8c87-dafbfa3e2414 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.406191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.407010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.407296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.407582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.412008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.412796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.413074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.413343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.418855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.420319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.421089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.423006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:36.435243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:36.436119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:36.437023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 266/536] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:36.437948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:36.438707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:36.439522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 271/537] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:36.443144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.445363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.556367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c839-7b8a-45b5-b83e-5eb8d9314e60 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.590625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.591783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.591783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.591783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.593523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.593523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.594356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.607093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 272/538] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:36.612721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.613406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64362bca-756e-44c6-9496-8e9c2096efa0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.675097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.678244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.678751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.679233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.680248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.680751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.682416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.711567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af196826-3c9c-4ae1-a516-87f564459744 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.713974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 267/539] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:36.719679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:36.763841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.764508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.764790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.765064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.765925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=9bc3cba26628440a84f722b77f4e1f84) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.766238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.767664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e77bd4-689e-44a4-a1a4-c5f997ecf991 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.781139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 273/540] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/role_assignments?user.id=9bc3cba26628440a84f722b77f4e1f84&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:36.837691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e56f7-3963-4bcb-8ddf-16fa2417af13 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:36.874063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:36.875072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.875597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.876068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.877083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=8a422e2a9c3640e888f2743aa9c7c199) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:36.877624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:36.879445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c32adf-ee90-4917-ac52-dd9f9eedc098 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:36.886427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 268/541] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:36 2022] GET /identity/v3/role_assignments?user.id=8a422e2a9c3640e888f2743aa9c7c199&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:36.916623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a632-5994-4ff7-a6aa-0bfd8c5e01fe None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.916951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a632-5994-4ff7-a6aa-0bfd8c5e01fe None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.917194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a632-5994-4ff7-a6aa-0bfd8c5e01fe None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.919107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 274/542] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:36.925169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:36.925576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:36.925805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:36.950680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:36.951928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:37.043350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 269/543] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:37.076717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9a632-5994-4ff7-a6aa-0bfd8c5e01fe None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:37.230672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9a632-5994-4ff7-a6aa-0bfd8c5e01fe None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:37.276636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:37.277856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:37.278340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:37.278806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:37.298583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:37.307214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:37.308171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:37.308942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:37.315929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 275/544] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:37.317821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:37.444450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33263eb9-3e70-4fec-91aa-a4276bfc426c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:37.495635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:37.496317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:37.496600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:37.496876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:37.497647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:37.497954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:37.499330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:37.510564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 270/545] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:37.516395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:37.627565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bb572-69f7-4f42-b898-16a1b7b81016 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:37.668180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b131b-2324-4892-ac39-239a64710959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:37.668983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b131b-2324-4892-ac39-239a64710959 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:37.669266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b131b-2324-4892-ac39-239a64710959 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:37.669565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b131b-2324-4892-ac39-239a64710959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:37.681171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b131b-2324-4892-ac39-239a64710959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:37.682753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b131b-2324-4892-ac39-239a64710959 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-286b131b-2324-4892-ac39-239a64710959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:37.706219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:37.708779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:37.710898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:37.710898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:37.710898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:37.710898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:37.710898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 276/546] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:37.717587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:37.842631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddea49-ece1-4faf-bef9-0122126c691a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:37.881555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:37.882230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:37.882518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:37.882799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:37.883522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:37.883837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:37.885217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:37.901919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 271/547] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:37.907029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b131b-2324-4892-ac39-239a64710959 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.074501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b131b-2324-4892-ac39-239a64710959 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.120088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.120893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.121186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.121465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.134594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:38.136072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-eb824ad1-3fba-4352-9039-6900b1e32e30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:38.153827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:38.156095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:38.158249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 277/548] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:38.161914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.227216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b46e4-e72d-469f-bf28-dca1039c0102 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.227522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b46e4-e72d-469f-bf28-dca1039c0102 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.227775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b46e4-e72d-469f-bf28-dca1039c0102 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.229130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 278/549] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:38.234512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.234795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.235080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.267301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10504e79-a53b-4372-a584-3b914584a530 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.275050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:38.277059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:38.305436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.306141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.306423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.306693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.307533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:38.307841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:38.309337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:38.348154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 272/550] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:38.353708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.373635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 279/551] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:38.434416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.525757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b9983-2df4-4ffa-8c22-79404bfa3fa7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.569165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.570666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.571115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.571537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.577926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49c9ee-5fdf-4c15-a2f9-c7c99c86b33d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.620746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.622115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.622837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.623263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.637613 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:38.648006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f24b463b-3594-4cd8-b73d-0f928e5dcec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:38.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:38.650286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:38.651064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:38.651653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:38.657754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 280/552] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:38.657754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050a46-dfac-4e37-b083-a2e749eae3c7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.657754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050a46-dfac-4e37-b083-a2e749eae3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.657754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050a46-dfac-4e37-b083-a2e749eae3c7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.657754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 281/553] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:38.663021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.663365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.663710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.681064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:38.682323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:38.757731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 282/554] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:38.758807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.784662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 273/555] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:38.790582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.859706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dfd91-9562-4605-a773-b9163ecda804 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.894367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.895764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.896146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.896519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.897356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:38.897783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:38.899506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:38.912631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 283/556] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:38.912631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:38.912876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe777a-4110-4f36-8d3d-ae1afc12a0df None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:38.946689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:38.947823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:38.948330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:38.948802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:38.959671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:38.961400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:38.979766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:38.980610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:38.981422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:38.981422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:38.981422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:38.981422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:38.983658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 274/557] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:38.984707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.016411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad43a-9250-4ac8-b325-fd28b6e4e489 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.050932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.052595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.052930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.053209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.063553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:39.071750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.072629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:39.073930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:39.077696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 284/558] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.078547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.091469 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc01b-89bc-4fea-ba6c-ca68108c319c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.128649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.129956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.130447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.130924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.142503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.144316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:39.163612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.164455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.165275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:39.165275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:39.165275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:39.165275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:39.171506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 275/559] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.171506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.191226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512856da-dd8b-4eee-b9d0-189d9c16e4ee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.225851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.226514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.226794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.227069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.227795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.228281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.229510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.241553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 285/560] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.242398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.289088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8dd2b-086d-41b5-ab32-309476ce8eec None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.322939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.323613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.323899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.324180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.324925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.325237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.326640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.334761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 276/561] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.337590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.341409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35beaf4-c817-4103-b387-15c36496e506 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.374231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.374893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.375210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.375507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.376224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.376531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.378003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605978b-baf9-4812-96df-be3f7f203414 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.390216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 286/562] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.391523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6779-6fba-41f8-bc09-026cede69813 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.391808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6779-6fba-41f8-bc09-026cede69813 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.392084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6779-6fba-41f8-bc09-026cede69813 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.397626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 287/563] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:39.397626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6779-6fba-41f8-bc09-026cede69813 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.441621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b6aef-39be-44da-9a47-e7ba52d04858 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.474365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.475147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.475432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.475709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.482360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.483804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:39.498111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.499479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 277/564] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.500461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.501663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6779-6fba-41f8-bc09-026cede69813 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.536783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.537610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.537901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.538169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.548314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.549778 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-60662c09-3532-444b-907d-b50ecb311c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:39.567541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 288/565] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.570803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.571698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.587634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:39.588795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:39.608594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933e661-bead-4704-9fcb-1fa8138392e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.642210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.643016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.643301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.643580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.652271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.653933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.665558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 289/566] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:39.665558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:39.670083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.671037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:39.671913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:39.675933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 278/567] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.678212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.773962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2338aea-126c-4adc-b0e8-9b8ef0f0be2b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.776667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b005-a4a5-433d-b364-007d83853b3f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.807159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.807825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.808104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.808375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.809152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.809457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.810061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.810728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.810925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.811017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.811286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.812002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.812403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.813693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.823261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 290/568] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.824327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.824865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 279/569] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.825696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.919565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef53e-8c56-4468-8939-f41edc88afb6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.922474 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196613f4-ce85-4517-9a98-b2662c08004a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:39.952583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.953237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.953553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.953831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.954321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:39.954650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:39.954957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:39.955106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:39.955390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:39.955668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:39.956368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:39.965849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:39.974014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 291/570] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:39.974183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:39.975108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:39.976343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:39.976952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:39.977024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 280/571] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:39.977024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.070923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f1a0-e6fa-4609-b8df-903603472315 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.072667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3604ea-3f1d-4496-9a16-2a84a66a118b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.102629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.103296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.103582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.103857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.104668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=c8fda86f5de6480f98993a7a5888112a) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:40.104780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.104976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.105573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.106078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.106493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d176-2765-4738-b7a3-bc9e2fa08693 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.106594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.111822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 292/572] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/role_assignments?user.id=c8fda86f5de6480f98993a7a5888112a&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:40.113344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1717b-cd12-4d9d-85d6-5e144d723226 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.113731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1717b-cd12-4d9d-85d6-5e144d723226 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.114011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1717b-cd12-4d9d-85d6-5e144d723226 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.115273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.116798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.117607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 293/573] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:40.118625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1717b-cd12-4d9d-85d6-5e144d723226 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:40.132807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.133956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:40.134868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:40.135382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 281/574] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.136624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.242235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d4434-3c2b-42f9-b3fd-5c2213b5ccfd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.242695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1717b-cd12-4d9d-85d6-5e144d723226 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.279424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.280091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.280534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.280768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.281008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.281106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.281311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.281558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.282091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:40.282573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.283955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9832d1f-c789-42bb-8211-f875fd5da472 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.292531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 282/575] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:40.293323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.293818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.294104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.294383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.295235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.310931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:40.312126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:40.314086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.314960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.315858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:40.315858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:40.315858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.315858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:40.320330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 294/576] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.321045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.381255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 283/577] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:40.382419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.424088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1770-7458-487b-a021-cdde590195c9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.458874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.459551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.459862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.460149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.460974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:40.461285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.462786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.484093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 295/578] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:40.484093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.494194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f7850-9166-4a0d-b816-c755ffa08735 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.529752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.530916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.531258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.531536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.541348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.542996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:40.560709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.561642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.562530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:40.562530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:40.562530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.562530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:40.567647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 284/579] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.567647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.583504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d082f5-06ea-464d-bfc2-1a8538a12b13 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.618088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.618787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.619079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.619352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.620071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:40.620376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.621778 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.633678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 296/580] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:40.634563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.671359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcbaa-06ef-40df-b209-07e668b372ea None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.705156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.705985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.706269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.706546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.716433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:40.724664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.725578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:40.726598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:40.730435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 285/581] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.731246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.736765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34f9d0-9b8b-4496-b459-10fd58017e35 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.771202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.784654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.784654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.784654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.787769 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.789240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:40.806671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.807618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.808544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:40.808544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:40.808544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:40.808544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:40.808544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 297/582] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.809318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.834724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac1ce-4527-4e2c-9422-351fafd38477 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.868519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.869182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.869579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.869862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.870587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:40.870895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.872294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.884779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 286/583] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:40.885634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.913149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4ff0a-8b69-48d7-bf0b-b8924516be98 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:40.946366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:40.947158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:40.947444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:40.947722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:40.954484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:40.956026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:40.970379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:40.971266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 298/584] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:40.978527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:40.984177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47689eb8-a84d-470d-96e7-82565dd93d3e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.017738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.018405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.018691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.018969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.019734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.020094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.021663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.029560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 287/585] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.030154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.076529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d27d39-4dbf-4bbc-a2b4-6a8a36860c3e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.108500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.109087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.109370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.109672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.110391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.110700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.112054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.127482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 299/586] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.127482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.127726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995696-df23-4f20-9bf5-12d7c7d2a101 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.160622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.161418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.161755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.162032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.169631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.171086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:41.186316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:41.187250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:41.188191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 288/587] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:41.188799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.236217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e555c-1a31-4239-b7fe-412bf71e7c3a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.268113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.268774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.269057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.269339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.270753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.271066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.272504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.286097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 300/588] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.291326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.293312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3869e-798a-4402-8a25-3e8af62cfece None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.326746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.327540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.327820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.328093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.339217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.340802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:41.357781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:41.358915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:41.360002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:41.360002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:41.360002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:41.360002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:41.360975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 289/589] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:41.361861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.394530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5942-8b48-492a-badc-798ac564a89c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.433316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.434129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.434411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.434684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.442454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.443913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:41.457827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:41.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:41.459552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 301/590] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:41.460028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.469932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d4548-c6f1-4ff5-b75a-7a399873d7b3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.502059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.502721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.503007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.503285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.505173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.505303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.507013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.529505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 290/591] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.529505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.571789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442c67-871f-4c01-9df6-b27083edaea9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.604097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.604978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.605262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.605600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/1d7880dd036c4d1a86a80a3f0a1e6bba/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.619561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=1d7880dd036c4d1a86a80a3f0a1e6bba, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.620935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.624268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e380ccb-023e-4fb0-8cba-b0f217ef1417 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.633709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 302/592] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:41 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/1d7880dd036c4d1a86a80a3f0a1e6bba/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:41.634504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.665202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.666342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.666898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.667390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.668458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.668991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.670702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.689525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 291/593] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.690937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.762790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85f45-07df-418d-bbf3-89cc77d8d976 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.800163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.800828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.801371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.801691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.802811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:41.802938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.804328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.809421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7c8f1-8ded-47dc-b9c1-323c538ba5e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.821832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 303/594] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:41.822813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.849086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.850567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.851044 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.851498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.862770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.865332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:41.883963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:41.884856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:41.885772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:41.885772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:41.885772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:41.885772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:41.888268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 292/595] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:41.889226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:41.933337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df54c2-6ceb-4be4-a616-a57cded5a464 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.969310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:41.970352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:41.970543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:41.970910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:41.979561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:41.981097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:41.993583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deef325-823c-42c8-9345-9b7675cfc45e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:41.996791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:41.997699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:41.998626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 304/596] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:41.999219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.031369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.032627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.033112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.033613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.050494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=103951448cfc47bbb702f2117cc5b362, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.052958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.069457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 293/597] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:41 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:42.070796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.150060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52d8b1-4d13-4a22-96f5-f24755939019 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.208818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c322ed-7a78-4764-aeb0-11740ce715b5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.239511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.240268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.240560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.240839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.241631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:42.241943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.243380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.257738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.258796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.261308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.262110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.264293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:42.264853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.266600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.278882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 305/598] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:42.285136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.312174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 294/599] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:42.317789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.399726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206337-5b60-4694-ae22-61bb095ef568 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.445346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed695-e5cd-48ef-8b94-d59f3e68fe38 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.448974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.449802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.450145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.450419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.457518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.459142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2b2159b2-2921-4c38-8dd0-d4b258478f03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:42.473333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:42.474271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:42.475148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 306/600] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:42.476490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e156-e309-466f-8870-fba4a987c2aa None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.476730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e156-e309-466f-8870-fba4a987c2aa None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.477013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e156-e309-466f-8870-fba4a987c2aa None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.478524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 307/601] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:42.483556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e156-e309-466f-8870-fba4a987c2aa None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.488597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.490300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.490829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.491302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.505606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.508262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-31d4490c-fe0a-46b4-8046-c83908c9db50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:42.532580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:42.533521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:42.534443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:42.534443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:42.534443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:42.534443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:42.537243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 295/602] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:42.542945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.543422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.543846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.560804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:42.562300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:42.589892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e156-e309-466f-8870-fba4a987c2aa None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.624125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.624899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.625281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.625697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.626594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:42.626969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.628506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.632426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 296/603] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:42.633522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.655296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 308/604] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:42.660882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.739935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e21b70-f06f-4775-9ed8-3205b300b603 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.766310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913331cb-c090-46ad-98ac-bb0bf47ca65c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.774857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.775763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.776245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.776816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.777773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:42.778276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.779864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.791733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 297/605] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:42.796941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.800589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.802808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.802808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.802808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/9bc3cba26628440a84f722b77f4e1f84/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.817714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=9bc3cba26628440a84f722b77f4e1f84, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:42.819160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:42.837224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 309/606] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:42 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/9bc3cba26628440a84f722b77f4e1f84/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:44:42.838212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:42.911190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec58b-ac8c-4267-a373-0b41e9a27f1e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.954995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:42.956158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:42.956665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:42.957133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:42.969657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:42.969896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532642cf-97a4-4846-9ecb-3faef7bfdaba None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:42.978316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:42.979229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:42.980052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:42.982794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 298/607] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:42.990463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.013919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.014757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.015037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.015309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.023505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.025600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:43.042373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:43.043316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:43.044180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 310/608] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:43.050749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.172057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6704e1-b6e2-419f-8a31-dbc3e05f1060 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.188525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166244-745a-42bf-ad99-4d6d35b84201 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.212484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.213291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.213704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.214077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.214957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:43.215382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.216915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.228135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.228802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.229086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.229661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.230411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:43.230724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.231888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 311/609] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:43.232092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.237564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.240988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 299/610] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:43.247156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.345393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6796-48f7-46c8-973d-8709786df123 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.372061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6379-d768-4852-87db-989a8c49e3b7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.381866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.382842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.383209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.383552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/8a422e2a9c3640e888f2743aa9c7c199/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.403835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=8a422e2a9c3640e888f2743aa9c7c199, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.405375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.420181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.421328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.423193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.423470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.430312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 312/611] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:43 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/8a422e2a9c3640e888f2743aa9c7c199/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:44:43.446828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.448340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:43.469385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:43.471487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:43.473676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:43.473676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:43.473676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:43.473676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:43.473676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 300/612] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:43.479050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.614319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af0c8d-68db-42a1-9d29-dd2f5ac07fdc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.661606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.662658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.663154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.663628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.664563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:43.665068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.666677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.680057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 313/613] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:43.685149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:43.821235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b42f5-9d48-4d0b-8cb6-02f30f4730cc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:43.865128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:43.865876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:43.866157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:43.866426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:43.880598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:43.882085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:43.903978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:43.904949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:43.905866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 301/614] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:43.915043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.084344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2902bc-0c02-4b86-bf52-eae7830d7f20 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.142486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.143317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.143608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.143888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.144816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:44.145829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:44.148076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a6d34-3bca-4ce2-8402-8d7f9ac9ce6b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:44.171956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 314/615] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:44:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:44.181516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.365890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ae56-d202-4a29-a6c0-2a0e4911cef2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.394465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645924b-4110-4166-8adc-97d0cd5297cd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.395438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645924b-4110-4166-8adc-97d0cd5297cd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.395438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645924b-4110-4166-8adc-97d0cd5297cd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.397069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 315/616] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:44.402520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.403102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.403574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.408773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.409613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.410192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.410192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.424205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:44.425695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:44.443706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:44.444891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:44.447793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:44.448719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:44.449728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:44.449728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:44.449728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:44.449728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:44.449728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 302/617] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:44.454458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.602991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 316/618] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:44.630315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.633343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d27bad-5168-4bae-ab82-ba667d79fe36 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.682396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.682994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.683281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.683562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.684300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:44.684608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:44.686024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:44.708485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 303/619] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:44.713929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.778415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14586b-435b-4b41-b72a-045e40c0b70b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.818046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.818853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.819106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.819380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.829633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-aec912fc-2a2f-42ae-b0b4-e6e39be37550 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:44.838284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:44.839253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:44.840091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 317/620] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:44.841315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f9a-1dd6-4b74-b971-a1adceb89d00 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.841421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f9a-1dd6-4b74-b971-a1adceb89d00 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.841654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f9a-1dd6-4b74-b971-a1adceb89d00 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.847102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 318/621] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:44.847102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058f9a-1dd6-4b74-b971-a1adceb89d00 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:44.879200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0049-f033-4330-8693-8abe4e201d44 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.922184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.923583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.924019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.924761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.933840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:44.936226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:44.947689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058f9a-1dd6-4b74-b971-a1adceb89d00 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e7c7f7a4-502f-4b87-9294-34da326b20c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:44.954295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:44.955356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:44.956292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:44.958961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 304/622] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:44.960985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.961437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.962161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.982827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:44.984279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:44.985073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:44.985916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:44.986302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:44.986700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:44.987537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:44.989200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:44.990173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:44.999322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 319/623] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:45.000370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.076433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 305/624] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:45.077540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.124968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b384b4-93c5-4170-85d9-1c773712288a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.161318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.162206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.162584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.162954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.163861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:45.164893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.165849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.186451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 320/625] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:45.192196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.209223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448ecf-84b5-4618-931d-1a6cde5687fb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.244277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.245174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.245459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.245752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.256136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.257698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:45.275733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:45.276646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:45.277552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:45.277552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:45.277552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:45.277552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:45.277552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 306/626] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:45.278265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.313927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5623ca6-3251-469f-ab7a-6a8fb37e0a44 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.348993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.349827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.350107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.350378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.360416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:45.368384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:45.370536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:45.372517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:45.381494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 321/627] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:45.381494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.389358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a5ef-ed69-4da3-b0d4-ea77f3c5a902 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.432452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.433877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.434161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.434701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/c8fda86f5de6480f98993a7a5888112a/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.452101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=c8fda86f5de6480f98993a7a5888112a, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.453896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.470169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 307/628] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:45 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/c8fda86f5de6480f98993a7a5888112a/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:44:45.471234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.482986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff142a3f-e340-414d-8a09-2a20430a211b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.530382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.531252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.531666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.532070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.532952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:45.533383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.534955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.550026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 322/629] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:45.557093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.610448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04bec-59fd-4c76-83ae-999c4a5212fd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.648973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.649695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.649984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.650267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.651033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:45.651349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.652816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.662694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 308/630] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:45.668140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.688082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929935-2c9b-43e7-a101-2ad5db1ae4dc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.736918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.738859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.739381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.739381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.749800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.751289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ec842b9e-ec7d-4fce-b32e-445128b72f49 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:45.770323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:45.772292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 323/631] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f780464-6822-4497-a4c4-7da850afed96 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.773347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f780464-6822-4497-a4c4-7da850afed96 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.776033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f780464-6822-4497-a4c4-7da850afed96 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.777743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 324/632] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:45.783558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f780464-6822-4497-a4c4-7da850afed96 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.786015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332702-50be-4938-9c04-b4982dd67422 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.827826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.829296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.829801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.830591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.844223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.846674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-01900bfa-0c92-447d-9e78-8b5f698b4c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:45.869204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:45.870372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:45.871433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:45.871433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:45.871433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:45.871433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:45.873874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 309/633] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:45.875680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.876150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.876601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.897806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:45.900006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:45.906594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f780464-6822-4497-a4c4-7da850afed96 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:45.949743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:45.950615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:45.950979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:45.951371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:45.953379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:45.953888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:45.955825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:45.980735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 325/634] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:45.982010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:45.989577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 310/635] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:45.989577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.103755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3bcbc-f91c-4dd0-ac9f-dfab474de12f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.108652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1506c-da29-47c3-b41a-0d6e46c7bf3f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.146916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.147727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.148118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.148491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.149394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.150359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.150789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.151210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.152084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:46.152557 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.154190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.167271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 326/636] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:46.168386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.252554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.254590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.283623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1049e21-d56d-419f-983f-6c1c4efe7955 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.324447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.325280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.325596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.325877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.338967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:46.348510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:46.349503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:46.350343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:46.353632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 327/637] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:46.355417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.374505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 311/638] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:46.375429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.464856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfc6c1-b233-4462-810c-80ddcf3058f2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.477063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1a83-d8a3-49da-a1c8-1a1a380e67e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.499215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.500253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.500726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.501180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.510238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.510541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.511210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.511497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.512046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.512797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:46.513110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.513301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.514515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.523134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 312/639] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:46.523925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-501848e4-1417-425c-916c-ce3f2107191c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:46.528756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:46.529708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:46.530857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:46.532783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 328/640] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:46.534194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f434e-d3b6-4eca-983f-97253b163ee7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.534604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f434e-d3b6-4eca-983f-97253b163ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.535002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f434e-d3b6-4eca-983f-97253b163ee7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.536983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 329/641] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:46.537855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f434e-d3b6-4eca-983f-97253b163ee7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.628275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73773f-5133-4fad-946c-c7153476ed2a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.638323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f434e-d3b6-4eca-983f-97253b163ee7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.661107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.661930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.662216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.662495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.671628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.672419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.672703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.672878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.673074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.674410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.684536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.686091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:46.692110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:46.693437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:46.694387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:46.694387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:46.694387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:46.694387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:46.694387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 313/642] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:46.694724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5418bd65-e2ca-450b-9e36-2b910eafe037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:46.708500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:46.709502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:46.710605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:46.710605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:46.710605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:46.710605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:46.712138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 330/643] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:46.713454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.713762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.714039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.733919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:46.736062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:46.804318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9744-baef-4748-ab48-4cca8f206230 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.805815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 331/644] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:46.806659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.853152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.854560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.855302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.855768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.857200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:46.857725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.859348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.882205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 314/645] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:46.883664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.905492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c066-19da-4bb0-80bc-d36f8024c4a1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:46.938442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:46.939106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:46.939390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:46.939666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:46.940383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:46.940688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:46.942225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:46.958334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 332/646] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:46.958334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:46.983653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605d54-a6a2-40ec-b366-1b58115a9119 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.021397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.022192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.022477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.022755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.023477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:47.023783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.025166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.037039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 315/647] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:47.038386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.059345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372b72-d38a-48fc-80a5-c19625c292fc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.096406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.097192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.097508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.097877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.107675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:47.115768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:47.116673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:47.117516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:47.121779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 333/648] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:47.122363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.136625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b78d7-1e82-4603-b210-b6477684ceba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.169410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.170085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.170368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.170643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.221910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5356-4ed4-420d-a18e-f17b2e5e2d01 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.236818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.238836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.257994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.258779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.259065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.259346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.266275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.267687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:47.282899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:47.283884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:47.284747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 334/649] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:47.285835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.343047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 316/650] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:47.344450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.388808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39f8c-60d3-4d36-a340-da83e202c656 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.422635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.423429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.423841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.424218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.431440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.432881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.441236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dcf3d-3ae1-4e18-8e78-3b38086a4cde None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:47.447233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:47.448158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 05:44:47.449079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:47.452949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 335/651] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:47.453828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.479075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.479746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.480031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.480311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.481054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:47.481362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.482786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.490945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 317/652] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:47.491765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.557976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070d06c-b598-4b28-9d93-d52b5ec40ea8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.587117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965cd51-9812-4f54-8f66-5af23795612e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.591503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.592359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.592817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.593323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.594317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:47.594816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.596411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.608370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 336/653] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:47.609363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.623414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.624416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.624698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.624976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.635775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.637515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:47.654324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:47.655289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:47.656150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:47.656150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:47.656150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:47.656150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:47.656150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 318/654] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:47.656426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.718804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064d5d-ec6c-43d6-9224-be7270beaad7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.752168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.752833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.753116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.753394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.754808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:47.755114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.756529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.759843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d467-5607-4a62-b8c7-45638030bea5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.779074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 337/655] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:47.779074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.794352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.795294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.795580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.796132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.880268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eabf9b-f891-4a42-83fe-f2a9d6f3b746 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:47.914475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:47.915138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:47.915423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:47.915701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:47.916534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=1d7880dd036c4d1a86a80a3f0a1e6bba) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:47.916850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.918321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.924498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 338/656] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/role_assignments?user.id=1d7880dd036c4d1a86a80a3f0a1e6bba&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:47.925309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:47.931645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:47.933175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:47.952239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:47.953212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:47.954121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:47.954121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:47.954121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:47.954121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:47.954121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 319/657] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:47.954401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.038957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46177ac-a2b3-48ef-ace6-e641eac97bcc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.059501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b900d-5b09-46d7-a105-154e0809c11b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.075706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.076382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.076667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.076946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.077708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.078028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.079420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce26b0-ba44-4d89-a363-a6463934c3ec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 339/658] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709fe07-1895-4b8e-bf0b-aa6221a3ae34 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709fe07-1895-4b8e-bf0b-aa6221a3ae34 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709fe07-1895-4b8e-bf0b-aa6221a3ae34 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 340/659] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:48.095961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709fe07-1895-4b8e-bf0b-aa6221a3ae34 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.102302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.102999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.103278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.103557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.173853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.175580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ca5c-d2a2-4300-ad4f-8ec6ef17efb5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.213345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709fe07-1895-4b8e-bf0b-aa6221a3ae34 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.245583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.246244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.246528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.246807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.247525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.247829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.249193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.261251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 341/660] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.262508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.274282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 320/661] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:48.275577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.275864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.276141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.292326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:48.293505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:48.359017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 321/662] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:48.359870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.372962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29785-65bc-42fe-8092-db1d4c369c82 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.408787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.409601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.409884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.410193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.417337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.418803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:48.432096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:48.432960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:48.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 342/663] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:48.434445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.460716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bda28-96d8-4bfe-a34b-f0118973ba50 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.495642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.496437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.497362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.497692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.505600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.507058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:48.522402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:48.523374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:48.524297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 322/664] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:48.524915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.538773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623738-6804-4f73-86e6-1c01c68016a7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.575513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.576311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.576600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.577295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.591616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.593258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:48.612673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:48.614317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 343/665] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:48.615195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.627013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe61a-24d1-4acb-99c1-f742f968516a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.659972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.660693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.660976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.661273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.671601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:48.679656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:48.680552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 323/666] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:48.686764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.719014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e671-4e50-44d9-817a-accefebf8529 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.752799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.753464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.753779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.755004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.755478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.755793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.757246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.770945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 344/667] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.771782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.789377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84a75f-8dcc-4d0f-9fcd-a1cd9d1cc4d9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.822056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.822722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.823002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.823276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.824109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.824748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.825926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.843926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 324/668] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.844750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.872331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410a80-c324-4ed1-8087-4ebacb6eb788 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.905390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.906064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.906348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.906623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.907333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.907636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.909008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.919712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 345/669] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.920502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:48.941837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e875-63b8-4797-a817-f24e856303d2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:48.974955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:48.975618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:48.975903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:48.976180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:48.976918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:48.977225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:48.978597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:48.991007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 325/670] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:48.991007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.016117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86991-986d-43da-98da-f9986f3e839a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.048148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.048775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.049057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.049333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.050186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:49.050490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.051984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.065516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 346/671] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:49.065516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.088311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e499-0351-44e6-9877-73a6e182f38e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.125666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.126340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.126625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.126900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.178042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96674-a6e9-4df6-8608-efe9adee349c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.200416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.201926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.217434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.218762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.219409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.219910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.231337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.233266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:49.249839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:49.250775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:49.251689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:49.254967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 347/672] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:49.256065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.312803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 326/673] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:49.313677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.360800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd3e4-fb46-42a2-a39b-89dacd40071d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.396416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.397213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.397555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.397799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.408132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.409610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.415934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014318-0468-42b2-8242-4db6cebde2e6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:49.428226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:49.429130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:49.430036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:49.430036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:49.430036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:49.430036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:49.430036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 348/674] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:49.430322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.452305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.452941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.453226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.453535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.454328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:49.454634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.456105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.468787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 327/675] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:49.474349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.536606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9b07-d2d1-4df3-adff-da457a112f02 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.571540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.572347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.572632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.572914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.575048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae011-be9d-4664-afd5-b647729c6762 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.584305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.585826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:49.604320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:49.606245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 349/676] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:49.608037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.613098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.613098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.613098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.613098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.614289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:49.614289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.617513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.627564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 328/677] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:49.628468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.713913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6e8b7-9078-4446-84fd-e07fafa313cf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.732766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d0828-49e7-4952-8271-901fd0d8cbc8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.748521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.749187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.749491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.749777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.750612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=9bc3cba26628440a84f722b77f4e1f84) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:49.750929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.752526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.759574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 350/678] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/role_assignments?user.id=9bc3cba26628440a84f722b77f4e1f84&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:49.760230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.781496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.782200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.782483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.782758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.783486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:49.783790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.785828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.806484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 329/679] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:49.812253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:49.871081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73e6f4-d013-4681-bd1b-a70533d9b001 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:49.907431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:49.908252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:49.908599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:49.908874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:49.917606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:49.919083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:49.935133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:49.937329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:49.939547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 351/680] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:49.945541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.008114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a02c3-ed14-4eef-941b-ae4339c57cf8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.059618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.060496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.060783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.061062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.071529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.073157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:50.099958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:50.102105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:50.104181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 330/681] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:50.111001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.124302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc103fc-ec56-41b6-b1e6-06ca53a8e3df None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.158423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.159075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.159355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.159625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.160519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:50.160828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.162492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.181047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 352/682] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:44:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:50.188766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.217897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4812a1-ca44-4648-ac27-17c5787f7f7a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.254519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.255335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.255625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.256220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.257183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:50.257665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.259611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.275048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 331/683] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:50.281854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.305509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caaf2b-4b37-4fb1-b75c-df33b3cfde5e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.341370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.341965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.342248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.342523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.396841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231edc-ed3e-45df-99ce-fb030a3ad597 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.412433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.413948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.431966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9237e-349e-4336-a507-612741c678cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.433449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9237e-349e-4336-a507-612741c678cd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.433912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9237e-349e-4336-a507-612741c678cd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.434367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9237e-349e-4336-a507-612741c678cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.435351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9237e-349e-4336-a507-612741c678cd None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=8a422e2a9c3640e888f2743aa9c7c199) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:50.436212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9237e-349e-4336-a507-612741c678cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.438232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9237e-349e-4336-a507-612741c678cd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.446872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 332/684] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/role_assignments?user.id=8a422e2a9c3640e888f2743aa9c7c199&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:50.449452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbccf8-f1fe-4c30-8b8c-2ac6cc464ea5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.449957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbccf8-f1fe-4c30-8b8c-2ac6cc464ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.450400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbccf8-f1fe-4c30-8b8c-2ac6cc464ea5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.456743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 333/685] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:50.459745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.460281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.460800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.500183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:50.504265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:50.617770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 353/686] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 05:44:50.623084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.629599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 334/687] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 05:44:50.655168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.750507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f298f8-79c4-4233-8385-0ad8b02e6e70 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.789784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d30f9-e31e-4b84-914a-0b9960fe2f58 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.793095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.794028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.794382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.794729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.805875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.807431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:50.829307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:50.830259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:50.831132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:50.831132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:50.831132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:50.831132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:50.831132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 354/688] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:50.831398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.831398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.831398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.831398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.835030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.845423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.847573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:50.871174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:50.872139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:50.873031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:50.873031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:50.873031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:50.873031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:50.880923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 335/689] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:50.882880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:50.958310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe335-3eb2-422c-b000-02fbf4fa5d03 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.993003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:50.993860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:50.994240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:50.994618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:50.995239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623ad73-d84b-45f8-9344-20e72766bdf9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:50.995592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:50.996005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:50.997552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.009465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 355/690] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:51.015076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:51.057357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.058067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.058402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.058680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.059629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:51.059945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:51.063197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.088517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 336/691] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:51.093970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:51.175335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36d39c-1510-49c3-85e1-49e35f78eade None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:51.211678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.212481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.212766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.213045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.220031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:51.221607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:51.236532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:51.237439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:51.238485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 356/692] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:51.243485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:51.264784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88ab3-bee2-4bc3-a322-3836ca291f61 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:51.306816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.307551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.307837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.308118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.308878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:51.311689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.352209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 337/693] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:44:51 2022] POST /identity/v3/users => generated 254 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:51.426518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452fe8-484e-4c8c-805a-d6f31feef6cb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:51.475432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.476379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.476839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.477269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.478248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:51.478738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:51.480378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d560f-0f5f-4dc3-b1d9-19fc92b0fbf5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.494681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 357/694] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:51.501637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:51.629500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf7e67-62b0-4f87-abee-757adc28eb10 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:51.664525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.665182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.665485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.665767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.666665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=c8fda86f5de6480f98993a7a5888112a) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:51.666978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:51.668403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b531c2b-8cc2-476f-9dac-9dc09269fcf4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:51.674805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 338/695] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:51 2022] GET /identity/v3/role_assignments?user.id=c8fda86f5de6480f98993a7a5888112a&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:51.692223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314198ff-df6f-46a7-9f93-2b3285c6e464 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.692881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314198ff-df6f-46a7-9f93-2b3285c6e464 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.693371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314198ff-df6f-46a7-9f93-2b3285c6e464 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.695467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 358/696] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:51.701584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.702242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.702747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.721710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:51.724054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:51.799955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 339/697] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:51.824731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314198ff-df6f-46a7-9f93-2b3285c6e464 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:51.940035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314198ff-df6f-46a7-9f93-2b3285c6e464 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:51.974205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:51.974935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:51.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:51.975496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:51.985615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:51.993386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:51.994344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:51.995193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 359/698] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:52.002180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.111309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350fd41-9f4a-4fda-af70-2c2420b592ad None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:52.148604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:52.153546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:52.163509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 340/699] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:52.169150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.287043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05ca8-be66-40e0-a999-0bab23a9ab24 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:52.327452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:52.328254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.328535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.328812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.342549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:52.343989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:52.368383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:52.369390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:52.370296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:52.370296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:52.370296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:52.370296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:52.370296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 360/700] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:52.375491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.526684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71ec78-6bce-4280-ab52-4b269a6630cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:52.574274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:52.575245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.575702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.576163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.577058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:52.577564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:52.579124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffbe70-d0dc-4a54-b5cb-9483fefbeaed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:52.592211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 341/701] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:52.597829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.626315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289b3b-8e13-4d1e-8c52-1d1e7a6f4a0d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.626609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289b3b-8e13-4d1e-8c52-1d1e7a6f4a0d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.626889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289b3b-8e13-4d1e-8c52-1d1e7a6f4a0d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.628509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 342/702] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:52.633833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.634131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.634415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.665318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:52.666854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:52.763082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9cfc1-974a-424b-968a-5ef2caa6366d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:52.788757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 343/703] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:52.817547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.819881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:52.820684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:52.820971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:52.821246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:52.836902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:52.838323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:52.861230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:52.862267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:52.863263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:52.869919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 361/704] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:52.875302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:52.979588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a6250-e30d-4286-a264-9fb7251ce346 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.002867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e790b1-bbc8-47ce-9ccd-5aeb9da9e84e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.038668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.039957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.040495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.040976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.042087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:53.042607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.042845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.043660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.043944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.044221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.044883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.045367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.046272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.064664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 362/705] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:53.071292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:53.072305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:53.073124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 344/706] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:52 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:53.074904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.078257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.236563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18883774-2bbd-49ff-bd79-2d88d1526cc8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.249610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b44979-c07a-40dc-8597-9747348bddeb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.296115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.296781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.297064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.297340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.298069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] RBAC: Adding query filter params (name=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:53.298375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.299738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.305941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 345/707] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:53.309202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.309877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.310159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.310430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.323721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.437843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.439208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7b43c-2dfc-4b97-aaa8-ff6e95b83075 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.499272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e226a7-a2ca-4593-9b22-2e0912e1c79f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.562721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.563390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.563657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.563935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.564644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:53.564949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.568062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.580451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 346/708] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:53.603145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 363/709] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:53.608955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.620549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab05a-55b3-4b50-b98f-de807bde078c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.620913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab05a-55b3-4b50-b98f-de807bde078c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.621099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab05a-55b3-4b50-b98f-de807bde078c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.624886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 364/710] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:53.630989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.631293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.631546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.663208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:53.664398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:53.772139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54075-e9b2-4549-b091-ecfb6023ff0d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.808424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 365/711] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:53.835993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.836348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.837346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.837889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.838582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.854192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.856159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:53.883016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:53.884083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:53.884972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:53.884972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:53.884972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:53.884972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:53.884972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 347/712] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:53.890057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:53.950799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812b9ff-6ffe-413f-82b6-661a2e5f4fe6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:53.985947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:53.987141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:53.987657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:53.988817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:53.989819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:53.991414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:54.006044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:54.007033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:44:54.007873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:54.010784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 366/713] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:54.018473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.032152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d761dd-75f2-4d58-86bf-724bff27221e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.096532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.097711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.098347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.098859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.099798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:54.100322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.101977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.119765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 348/714] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:54.125398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.222433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9e209-b7e3-44aa-ad2b-1f164ada3b6e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.283745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.284776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.285951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.286515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.288584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:54.289113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.290723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.300089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 367/715] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:54.305767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.314264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5adcd-f9f7-4027-8c6e-c831d3c9cc31 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.374483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.376159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.376682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.377412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.386586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.389365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1b5a978b-e151-434b-86e5-635825469bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:54.407523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:54.408441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:54.409308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:54.413067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 349/716] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:54.420263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04fc8-f5db-4b64-8ec0-b13a7dc64d16 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.420263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04fc8-f5db-4b64-8ec0-b13a7dc64d16 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.420263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04fc8-f5db-4b64-8ec0-b13a7dc64d16 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.420263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 350/717] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:54.420263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04fc8-f5db-4b64-8ec0-b13a7dc64d16 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.445305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ac5f7-a2e7-4faf-afcc-6f40583dc08a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.480636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.481706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.482233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.482745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.483658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:54.484159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.485745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486dc6-284a-4129-95ce-3031c2464fec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.497772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 368/718] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:54.499559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816359f2-14bb-4884-b8e9-6dfe0d451853 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.500045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816359f2-14bb-4884-b8e9-6dfe0d451853 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.500550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816359f2-14bb-4884-b8e9-6dfe0d451853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.535918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-816359f2-14bb-4884-b8e9-6dfe0d451853 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:54.537687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-816359f2-14bb-4884-b8e9-6dfe0d451853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:54.544065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04fc8-f5db-4b64-8ec0-b13a7dc64d16 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.581175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.581946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.582431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.582942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.583754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:54.584069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.585668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06cd5c-2b3b-4176-8db7-589a8f03ac27 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.603819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 351/719] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:54.605442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1a7-afc8-47e3-9b0d-121612b56011 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.605777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1a7-afc8-47e3-9b0d-121612b56011 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.606062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db1a7-afc8-47e3-9b0d-121612b56011 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 352/720] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:54.608632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7db1a7-afc8-47e3-9b0d-121612b56011 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.626652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 369/721] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:54.628124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.628407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.628744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.646406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:54.647710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:54.724493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 370/722] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:54.725759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.742265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7db1a7-afc8-47e3-9b0d-121612b56011 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.782626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.783507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.783868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.784208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.785351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:54.785761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:54.787633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:54.801549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 353/723] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:54.801549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:54.885571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c077ba-ac52-4053-a8e7-5081f05a24ce None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.929869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:54.931105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:54.931644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:54.932213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:54.950558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:54.959032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2eae9-f125-4f92-b5bd-6f41fad816d7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:54.971373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:54.972472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:44:54.973526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:54.979193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 371/724] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:54.984809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.038223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.038960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.039251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.039576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.050744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:55.058568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:55.059506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:55.060325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 354/725] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:55.066725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.159404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a79-b939-47de-906a-f1c8e36af247 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.188071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358055-b023-4b74-a746-f550754f47e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.217598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.218660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.219140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.219606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.220551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:55.221051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.223494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.226748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.227427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.227712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.227993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.228745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:55.229061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.230449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.233837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 372/726] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:55.239608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.242362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 355/727] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:55.249520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.432060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a15e-2de1-4238-a3c2-3e1e31dbd749 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.434169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2cdad-3a12-449c-a94e-3e51c8cb2749 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.484587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.485808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.486294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.486768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.498747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.500678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.507112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.507907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.508192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.508472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:55.521810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:55.522738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:55.523601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:55.523601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:55.523601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:55.523601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:55.525848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 356/728] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:55.531571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.532556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.534218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:55.578900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:55.580009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:55.581101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:55.581101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:55.581101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:55.581101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:55.583249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 373/729] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:55.588201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.643032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0147-48df-436f-b22b-3cb2858cb41e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.677695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.678521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.678895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.679274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.680109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:55.680515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.684725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.694630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 357/730] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:55.699951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.799579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e113e-dea1-4d74-97a4-1c4de6e0f0f0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.809773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ca14-8931-4eef-8f32-8e645ac5141d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:55.847145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.849274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.849594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.849876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.858106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.860061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.867748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:55.868410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:55.868689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:55.868963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:55.869709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:55.870013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:55.871437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:55.877608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:55.878661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:55.880029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 358/731] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:55.884598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:55.998441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfa2f4-0064-4397-825e-187820cb484b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.034709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.035944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.036298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.036477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.037324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:56.037662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.039140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.058959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 359/732] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:56.064381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.101057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 374/733] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:56.106313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.193512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a758-1ddb-4d1f-8ad0-55aaa5b3f628 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.253173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.254623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.254907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.255238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.283537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9cd7-bc20-41ea-aa51-2f4816b41f7d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.316881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.317731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.318014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.318290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.325353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.326830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.336789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.338264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073534-8cc4-48b1-815e-695747819bf2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-86f53ec5-5282-46a3-9d85-3a37209774c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:56.342195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:56.343102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:44:56.344008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:56.348388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 375/734] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:56.349456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f408-f860-44d6-8256-35188eefa91b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.349757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f408-f860-44d6-8256-35188eefa91b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.350034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36f408-f860-44d6-8256-35188eefa91b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.351552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 376/735] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:56.352338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36f408-f860-44d6-8256-35188eefa91b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.449136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 360/736] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:56.450555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.450846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.451128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.468720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:56.469929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:56.482803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36f408-f860-44d6-8256-35188eefa91b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.517959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.518733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.518910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.519242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.520319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:56.520632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.522131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.541399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 377/737] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:56.542327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.545568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 361/738] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:56.546472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.645571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ee03b-4003-44c5-8692-20ea3f072834 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.666041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7286-c0d0-450e-8db7-c7f5d7854097 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.680339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.681137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.681416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.681718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.692539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.694157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.700282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.700938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.701220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.701520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:56.712947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:56.715070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 378/739] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:56.717136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.780151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.781547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.824107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426070c2-b46e-4233-b1bb-f5483b26231a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:56.862785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:56.863992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:56.864305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:56.864583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:56.865490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:56.866933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:56.883672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 362/740] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 05:44:56.884611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 379/741] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:44:56 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:56.889262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:56.890505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.006951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3dfab-c66f-4f5a-ba36-9fd761392d76 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.105111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.105731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.106015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.106291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.107030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:57.107338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.108735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.115496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5eca2-2046-4664-9502-977f05cb1718 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.140079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 363/742] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:57.146017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.178346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.184243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.184243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.184243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.196833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.199067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0cde3ee0-e27b-45c8-984e-7362f1818967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:57.219584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:57.220600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:57.221459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:57.221459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:57.221459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:57.221459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:57.221459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 380/743] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:57.226423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78fc1-08cf-47b2-84a7-ee782bb038b5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.226712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78fc1-08cf-47b2-84a7-ee782bb038b5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.226994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78fc1-08cf-47b2-84a7-ee782bb038b5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.228448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 381/744] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:57.229371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa876-c50e-467e-9b94-8af9104cb3ff None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.229723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa876-c50e-467e-9b94-8af9104cb3ff None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.229996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa876-c50e-467e-9b94-8af9104cb3ff None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.233547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 382/745] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:44:57.233547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa876-c50e-467e-9b94-8af9104cb3ff None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.266938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d729-bcf7-479d-8518-b9f468428163 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.299880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.301236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.301544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.301828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.308496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.309983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5ed11c48-9e7b-468e-b675-bfe561859fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:57.324254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:57.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 364/746] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.330999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.331661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.337038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa876-c50e-467e-9b94-8af9104cb3ff None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.345833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:57.347145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:57.371004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.371998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.372447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.372912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.373798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:57.374272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.375763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803fd38-b102-4268-b4b2-56be0d082f46 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.391904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 383/747] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:57.391904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.391904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.391904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.408046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:57.409229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:57.416513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 365/748] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:57 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:57.417630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.482504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 384/749] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:57 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 05:44:57.483411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.533385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59de2-7640-4de9-9c9a-09a343155b78 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.568581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.569236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.569547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.569826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.570616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:57.570926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.572363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.588672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 366/750] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:57.588672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.602128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c101-1d75-4798-927a-cb4ed0bcf527 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.635301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.636010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.636292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.636569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.643259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.645232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:57.658676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:57.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 385/751] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:57.665311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.690123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c110a6-0cab-474a-91ba-7f36b91d0731 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.723860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.724622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.724915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.725195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.725941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.727314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.742476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 367/752] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:44:57 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:44:57.743283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.781885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5283-1b47-468c-93c7-44636b75a6d0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.825141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.825710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.826051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.826379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.839707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:44:57.847888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:57.848885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:44:57.849743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:44:57.853911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 386/753] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:57.854876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.878079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a67d-49ca-4d72-b76b-e7c488ea65d8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:57.927314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:57.928299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:57.928585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:57.928865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:57.930183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=c8fda86f5de6480f98993a7a5888112a) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:57.930504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:57.931944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:57.945546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 368/754] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/role_assignments?user.id=c8fda86f5de6480f98993a7a5888112a&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:57.945546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:57.979350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd62-e6ba-4d5d-9b3d-e6bba13da939 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.029623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.030306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.030589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.030863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.031668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:58.031981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.033448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.050440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 387/755] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:58.056893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:58.071064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c910f0-c503-4e78-81d4-77347eec77cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.109725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.110522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.110751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.111088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.111915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:58.112231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.113799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.123416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 369/756] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:58.134598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:58.169460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e647a1-f584-4592-8344-99b0501bf29f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.205772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.206426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.206775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.207267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.208098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=859e14db8cca4e4688078ef692a8b5e8) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:58.208412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.209863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.215730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 388/757] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/role_assignments?user.id=859e14db8cca4e4688078ef692a8b5e8&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:58.253004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb03df-9d76-4a25-a4db-8f69141f8a38 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.293607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.294422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.294708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.294987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.307444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.308927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:58.328192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:58.329136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:58.330050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:58.330050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:58.330050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:58.330050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:58.330050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 370/758] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:58.335535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:58.444971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f449f-f281-4a82-bd18-1158cbae26f3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.479405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.480070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.480352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.480628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.481351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:58.481687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.483050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.499238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 389/759] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:44:58.502060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:58.612477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736e9c4-3966-47a0-90da-f27f6c9d2593 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.651682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.652496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.652784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.653065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.666553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.668012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:44:58.683186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:58.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:58.687022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 371/760] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:58.694570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:58.817976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137afd5-7319-4a50-b442-40fb99da859b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:58.852586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:58.853258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:58.853568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:58.853856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:58.854777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:58.855089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:58.856571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:58.875899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 390/761] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:58.884027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.016279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ec08-ae15-4e1c-bf23-a27c70ff6643 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:59.061946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:59.062739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.063023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.063302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.078776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:59.080152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:44:59.100879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:59.102952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:59.105005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:44:59.105005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:44:59.105005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:44:59.105005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:59.105005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 372/762] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:59.114638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.277635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf026f4-1c04-4283-8218-af48ce28ba99 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:59.340266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:59.340865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.341207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.341500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.342245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:59.342556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:59.343930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:59.360117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 391/763] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:59.366341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.510331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1467f2-7da3-455c-946a-ce63a26f1596 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:59.554941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:59.555735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.556019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.556294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.567153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:59.568587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-117943a0-0e20-42b2-8875-f336f19d1b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:44:59.586771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:59.588863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:59.591046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 373/764] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:44:59.595569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.705302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11da9-87bb-4c58-a3f9-904febcfac4a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.705302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11da9-87bb-4c58-a3f9-904febcfac4a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.705302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11da9-87bb-4c58-a3f9-904febcfac4a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.707326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 374/765] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:44:59.717495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.717495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.717495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.729775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:44:59.730962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:44:59.767576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476ad7-e2c1-49ff-a2e9-41058dc0c1fd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:59.799543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 375/766] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:44:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:44:59.822358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.834438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:59.835107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.835392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.835663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.836450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:44:59.836757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:59.838213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:59.850712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 392/767] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:44:59.858142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:44:59.928203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04033f-136b-4ac5-ae48-63b8206160a9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:44:59.962814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:44:59.963619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:44:59.963909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:44:59.964191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:44:59.964848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:44:59.966247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:44:59.978402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:44:59.979363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:44:59.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 376/768] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:44:59 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:44:59.985716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:00.075028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15776fc8-506f-41f6-9adf-da05807a4edb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:00.087721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4cb0-6b94-4fa7-99ff-84ba40d8e3d5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:00.121768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:00.122360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.122648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.122930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.123649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] RBAC: Adding query filter params (name=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:00.123961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:00.125326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:00.130368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 377/769] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:44:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:00.135736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:00.161412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:00.162457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.162742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.163021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.166509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=103951448cfc47bbb702f2117cc5b362, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:00.168021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:00.202430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 393/770] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:44:59 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:00.294727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d835b25-6b1e-4ad1-a287-c9c50e38aa2a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:00.349249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:00.350330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.350835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.351310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.352267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:00.352783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:00.354415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:00.363033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 378/771] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:00.369113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:00.521866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d3f9-a13b-42c2-bf0b-135b7f6851ff None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:00.569088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:00.569780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.570063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.570339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.571135 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] RBAC: Adding query filter params (interface=public, service_id=3a2de4af5bd5478284ccebf3132d407c, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:00.571449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:00.572814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9f476-79af-4621-844d-d2925875db57 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:00.588793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 394/772] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:00 2022] GET /identity/v3/endpoints?service_id=3a2de4af5bd5478284ccebf3132d407c&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:00.594105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:00.697540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278acf0-e970-4ce4-811d-e3b3c0b320ef None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.697867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278acf0-e970-4ce4-811d-e3b3c0b320ef None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.698106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278acf0-e970-4ce4-811d-e3b3c0b320ef None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.699725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 395/773] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:00.705318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405ef8-4e9a-45cf-bd22-44c775149bf2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.705649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405ef8-4e9a-45cf-bd22-44c775149bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.705909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405ef8-4e9a-45cf-bd22-44c775149bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.713450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d013c2-add5-4e26-8774-ef6ac736c52b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:00.738465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3a405ef8-4e9a-45cf-bd22-44c775149bf2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:00.739666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3a405ef8-4e9a-45cf-bd22-44c775149bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:00.751441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:00.752115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.752401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.752680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.753450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:00.754864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:00.760486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 379/774] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:00 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:00.845816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 396/775] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:00.880867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:00.961600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c869e6-5531-4860-b6d6-c9fb8c1857cf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.961921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c869e6-5531-4860-b6d6-c9fb8c1857cf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.962169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c869e6-5531-4860-b6d6-c9fb8c1857cf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:00.964834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 397/776] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:00.975663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:00.975991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:00.976227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.002079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:01.003260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:01.006309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142f5b-7f67-40c9-ba18-6c4fedb42453 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.047337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.048378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.048981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.049404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.060987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:01.069112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:01.070222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:01.071254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:01.073448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 380/777] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:01.082968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.084590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 398/778] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:01.108603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.207432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b0b1-2399-4c8b-bf48-346fc0acdc1b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.225308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87309c8-5878-4775-9347-d7644cd1db0e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.247942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.248614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.248897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.249630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.251207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:01.252915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.255037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c4c4-1185-45d4-8f82-9692c5da1156 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.268969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.268969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.268969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.268969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.269542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.269542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.270269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 381/779] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:01.271450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551648-8d76-44c4-bc17-f9b32ab6677d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.271740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551648-8d76-44c4-bc17-f9b32ab6677d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.272020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551648-8d76-44c4-bc17-f9b32ab6677d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.273882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 382/780] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:01.274593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c551648-8d76-44c4-bc17-f9b32ab6677d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7409a115-5191-4282-b642-afbf07c842a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:01.296059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:01.297042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:01.297879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:01.299328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 399/781] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:01.301038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.301895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.302240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.319003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:01.320182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:01.399615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c551648-8d76-44c4-bc17-f9b32ab6677d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.403278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 400/782] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:01.404323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.459295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.460132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.460427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.460708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.473701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.475160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:01.494337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:01.495261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:01.496136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:01.496136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:01.496136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:01.496136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:01.500215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 383/783] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:01.501171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.525802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d77af1-241b-4ac5-8158-bd8ad0bcd294 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.562274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.562881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.563169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.563450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.564161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:01.564471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.566738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.571895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 401/784] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:01.572765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.626063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a1883-87df-4b7f-bb80-3f828eb70805 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.668090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.669763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.670414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.670996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.679349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b75b-417c-4dc2-9f4f-7df3203f44ae None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.686140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:01.696414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:01.697549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:45:01.698565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:01.701005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 384/785] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:01.702315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.719440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.720252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.720646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.721031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.721902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:01.722399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.723935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.735700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 402/786] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:01.736735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.830331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6f58-34b5-4c1d-a4d4-31d4aca2be8e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.843794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7250d1-932c-46e5-91d5-6b31d4a58156 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.873190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.874231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.874518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.874800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.875508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:01.875818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.877182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.882612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:01.883071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 385/787] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:01.883678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.884282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:01.884787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:01.885273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:01.886399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:01.887963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:01.889601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:01.899031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 403/788] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:01.900083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:01.983667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644586-f6dd-4505-92a3-180bc4e1082a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:01.998662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eb722-8717-4b55-a329-4871881579d2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.018330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.019766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.020229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.020662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.028721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.030413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.033632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.034398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.035317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.035688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.036575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] RBAC: Adding query filter params (interface=public, service_id=e26eac397a364fe79678c2b1ac7d145a, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:02.036991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.038488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.044074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 404/789] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/endpoints?service_id=e26eac397a364fe79678c2b1ac7d145a&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.044959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:02.047693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:02.048798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:45:02.049993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:02.052494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 386/790] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:02.053595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.150010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ed836-1c9f-4345-b249-495b98a43df5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.157010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8686-4fb8-4d17-b998-70ff8a504ff8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.192881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.193887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.194181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.194479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.195153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.196519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.198452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.199771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.200278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.200760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.201635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 387/791] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/services => generated 772 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.202431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.216201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.218399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:02.241058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:02.241996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:02.242869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:02.242869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:02.242869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:02.242869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:02.242869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 405/792] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:02.250571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.384235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e120-08f4-4516-ac01-356a00d503be None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.417343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3c9c-ff7b-4c16-9c33-8d057330f439 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.430593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.431270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.431549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.431821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.432666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:02.433026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.434573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.453724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.453918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 388/793] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.454787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.455074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.455351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.456071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:02.456894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.459480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.460578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.470730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 406/794] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.476697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.580432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dcab3-b69b-4657-b34e-eed23fb472a7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.591944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e615-77ca-48d7-be5b-2aa6b88a3e0f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.631319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.632401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.632844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.633260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.637506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.637506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.637506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.637506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.644612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.646763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.654054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.655881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:02.676488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:02.677492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:02.678458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:02.689979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 407/795] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:02.691805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:02.695288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:02.696163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:02.697047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:02.697047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:02.697047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:02.697047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:02.707781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 389/796] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:02.708974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.840491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2b17b-d466-4a54-91f2-455d7727d86b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.869391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e607-fe46-4530-ace2-89058e3f2b14 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:02.875611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.876583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.877071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.877593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.878621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:02.879138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.880712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.893356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 390/797] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.907193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:02.930528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:02.931889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.932378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.932876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.933994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:02.934525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:02.936180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90b9f-a4ae-4107-9f44-de0740bc6894 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:02.954924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 408/798] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:02.957104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70f47-ea8c-486e-a5bc-b021bcbf0c88 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:02.957628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70f47-ea8c-486e-a5bc-b021bcbf0c88 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:02.958169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec70f47-ea8c-486e-a5bc-b021bcbf0c88 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:02.963867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 409/799] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:02.964462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec70f47-ea8c-486e-a5bc-b021bcbf0c88 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.031802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b054-ceb2-46b4-8dff-523bed85427b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.067381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.068181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.068396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec70f47-ea8c-486e-a5bc-b021bcbf0c88 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.068502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.068740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.075676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.077146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-adf9e140-7d9b-49f6-9626-2bd774a70418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:03.093564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:03.094464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:03.095329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:03.100490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 391/800] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:03.102095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.102390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.102673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.113531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.114767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.115292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.115771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.122002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:03.123215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:03.128357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.130149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:03.149160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:03.150126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:03.150974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:03.150974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:03.150974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:03.150974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.154017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 410/801] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:03.155037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.201121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 392/802] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:03.202027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.284885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642627-78e9-4e70-9687-56167b1255c0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.305835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72664a2-e80a-4032-8843-ab90099ffd6f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.321217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.322107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.322569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.322994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.323926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:03.324382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.325991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.341572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.342148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.342435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.342914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.343054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 411/803] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:03.343632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:03.343876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.343973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.345242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fc7b4-c4ea-482d-a4b2-dbf01cfcf788 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.361988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 393/804] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:03.361988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d14f5-8d11-451d-8bf7-573b1e1473f6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.361988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d14f5-8d11-451d-8bf7-573b1e1473f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.361988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d14f5-8d11-451d-8bf7-573b1e1473f6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.361988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 394/805] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:03.366420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d14f5-8d11-451d-8bf7-573b1e1473f6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.449248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda3c4-0be8-4dc4-8a53-6f67d76b5e94 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.473755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d14f5-8d11-451d-8bf7-573b1e1473f6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.481357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.482187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.482470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.482749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.492890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:03.500462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:03.501378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.502285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 412/806] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:03.502981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.515591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.516574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.516877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.517161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/c8fda86f5de6480f98993a7a5888112a/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.519945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=c8fda86f5de6480f98993a7a5888112a, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.521428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9072-8676-49fc-a2b6-7aa42ccc140e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.536276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 395/807] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:03 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/c8fda86f5de6480f98993a7a5888112a/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:03.537748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.538137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.538519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.569023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:03.571631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:03.633970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916403e0-9285-404b-9a6c-d78a57715b5d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.670704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 396/808] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:03.671867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.687678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.688782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.689228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.689853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.701437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.703186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:03.719380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:03.720493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:03.721552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.723974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 413/809] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:03.729718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.806712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab34cf-3479-4c81-b419-a9fc606af7b4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.848368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.849283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.849752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.849864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d100-3189-49c9-b695-97e854e9c4f1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.850294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.851340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:03.852742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.854324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.866380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 397/810] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:03.867226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.893821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:03.895961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:03.896393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:03.896983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] PATH_INFO: `/v3/services/network` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:03.898115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:03.899927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:03.914873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:03.915990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 05:45:03.916812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:03.918847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 414/811] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:03.920330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:03.965818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3545b2-0f5d-45ec-9ed0-5a1d18edb04c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:03.999533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.000195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.000479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.000757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.001611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:04.001879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.003907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.021673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 398/812] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:04.021673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.030963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d8c79-a7c7-4b19-9a80-b7b5fe0d5517 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.074296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.075551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.076039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.076547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.087845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.089691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:04.107648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:04.108573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:04.109444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:04.109444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:04.109444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:04.109444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:04.112840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 415/813] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:04.113859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.129866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2429b-9ea0-44b6-ad46-c447c1e0b0cc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.165670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.166081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.166365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.166808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.167521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] RBAC: Adding query filter params (name=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:04.167829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.169190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.184200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 399/814] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:04.185112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.218762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940b883-6d88-423b-b604-5ae3f89c5242 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.252542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.254575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.255130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.255622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/859e14db8cca4e4688078ef692a8b5e8/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.271536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=859e14db8cca4e4688078ef692a8b5e8, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.273336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.285556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0a7c-5aff-49ec-8d02-634b912dc0ce None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.295364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 416/815] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:04 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/859e14db8cca4e4688078ef692a8b5e8/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:04.295364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.349401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.350107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.350387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.350662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.351393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:04.351699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.353080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.366581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 400/816] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:04.372345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.495082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe896-cb4d-40a5-9a54-aeff5b002dc9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.529331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31cc4-a70f-4de1-9945-a0f7ea153a7a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.536139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.537097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.537712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.538262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.539223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] RBAC: Adding query filter params (type=network) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:04.539729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.541611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.547411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 417/817] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:04.554460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.576404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.577229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.577575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.577857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.587934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.589414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:04.605846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:04.607058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:04.608177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 401/818] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:04.614264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.715500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0dd4-b904-4e20-8c71-6050ee75afae None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.723807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07b325-7797-4fe5-90ea-587cd987b192 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.749939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.750902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.751340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.751841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.752928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:04.753938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.755591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.774011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 402/819] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:04.779840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:04.795137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:04.796222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.796514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.796799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.797943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:04.799653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd51f4-ccf2-48eb-94e0-5e59b680ea83 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:04.826852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 418/820] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:04.828297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3623-bb63-46ee-aa90-99f2223dbd0d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.828628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3623-bb63-46ee-aa90-99f2223dbd0d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.828986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3623-bb63-46ee-aa90-99f2223dbd0d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.833994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 419/821] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:04.837502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:04.837795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:04.838092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:04.860897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:04.862402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:04.938975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f20ad6-ec4f-4d12-9346-93e8ba56f817 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:04.951043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 420/822] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:04.974940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.039600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.040536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.041101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.041389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.090507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d2829-81d9-42a5-b858-4fc7fd280442 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.129001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.130003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.130286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.130559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.131214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.132577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.132744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.134345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:05.147647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:05.149799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:05.150845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 421/823] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:05.160211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.258615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 403/824] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:05.263947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.298648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8bfa-8083-4abc-bc6e-055681a21a3f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.333076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.333780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.334063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.334333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.335032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:05.335351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.336699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.345706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 422/825] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:05.346728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.387350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299a2f-0e7e-4f23-9182-839d31d8e525 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.429818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.430870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.431304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.432136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.445701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.447871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.460184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23646d-54cb-4888-b72d-2baff81d43ea None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:05.467514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:05.468579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:05.469665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:05.469665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:05.469665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:05.469665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:05.475505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 404/826] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:05.476452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.502223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.504074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.504511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.505203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.506236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:05.506695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.508801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.515569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 423/827] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:05.522095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.590705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7677d7d-e74d-4b87-831f-499b5d7c9e91 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.626494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.627518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.627998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.629127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.630415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:05.630929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.632496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.639017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12567018-27d5-4ee4-abd1-a5a6c40b7b53 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.649498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 405/828] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:05.650667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.674588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.675474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.675770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.676043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.676866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.678366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.705503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 424/829] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:05.767608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4efc-4355-44de-87ae-c62dbea0c92c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.812941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.813843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.814135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:05.814411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:05.822994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:05.824473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:05.840260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:05.841271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:05.842219 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 406/830] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:05.850934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:05.958682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f3fc-cd36-4ece-971c-4f7b2f701d9c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:05.998766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:05.999433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:05.999720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.000002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.000803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:06.001117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:06.002713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca7e6d-676c-4d7f-a35d-0d306e7d136d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:06.016837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 425/831] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:06.022753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.042465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1820-6960-4e1f-beff-88444e11d855 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.045516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1820-6960-4e1f-beff-88444e11d855 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.045516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1820-6960-4e1f-beff-88444e11d855 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.045516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 426/832] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:06.049697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.050500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.050807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.069763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:06.071553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:06.126670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9777f2-2509-4ca9-b7c9-5d403e8333b4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:06.142437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 427/833] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:06.164561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:06.165963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.166537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.167020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.168433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.170329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:06.170653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:06.172730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:06.179010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 407/834] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:06.282073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f660-5fc4-484b-afd3-a3e4236f3410 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:06.321210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:06.322465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.322958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.323460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.336018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:06.344416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:06.345405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:06.346283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:06.350009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 428/835] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:06.358834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.462056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c11a-a8ff-4d12-9819-d78bcbca8f59 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:06.494965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:06.495641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.495926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.496205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.496953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:06.497261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:06.498660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:06.512655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 408/836] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:06.514444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.623254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5f9-3d32-45b3-9b30-947de0d2234f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:06.658072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:06.658876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.659165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.659580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.671152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:06.672607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:06.690376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:06.691308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:06.692424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:06.692424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:06.692424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:06.692424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:06.692424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 429/837] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:06.698727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.808112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b79ed-cdef-4c06-a33e-079a2a41bd0c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:06.841774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:06.842448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.842735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.843024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.843752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:06.844066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:06.845435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c93f-11b3-414a-a519-b54bb14bfa33 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:06.858956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 409/838] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:06.864887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:06.924968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c295-f072-4003-88c9-b2fcbfb931da None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.925355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c295-f072-4003-88c9-b2fcbfb931da None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.925774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c295-f072-4003-88c9-b2fcbfb931da None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.927456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 410/839] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:06.933124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:06.933441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:06.933728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:06.954533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:06.955738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:06.983478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a6ee9-65bc-4617-b9e6-10e187266ce3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.024176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.025366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.025898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.026455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.030737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 411/840] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:07.035455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.037133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.049777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:07.052463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:07.053377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 05:45:07.054428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:07.061431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 430/841] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:07.062930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.151885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6f999-447a-4a63-a035-291d9ff50fb7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.164375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3593d-1a73-43e1-99a7-a1a03e439208 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.187272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.188300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.188658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.189088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.200636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:07.209672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:07.210620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:45:07.211749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:07.212978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.213853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.214324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.214759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.215753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:07.216361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.216463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 412/842] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:07.217376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.218413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.241755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 431/843] 10.222.0.44 () {56 vars in 1135 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:07.243321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.324691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bc9ed-c9f3-4b1e-9d43-492df9866cb6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.342065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588744-36f8-4932-a54b-4eac54dfd128 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.360167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.360933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.361294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.361679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.362593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:07.363053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.364510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.377898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 413/844] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:07.378907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.380853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.381744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.382209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.382664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.453721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.455579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.484520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42fae0-c781-47cd-b082-1bb2eae666e6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.521262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.521903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.522193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.522475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.533601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.536174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:07.555728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:07.556712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:07.557632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:07.557632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:07.557632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:07.557632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:07.561721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 414/845] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:07.562801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.571589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 432/846] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 05:45:07.573178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.666256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4b4f-5dee-48b5-a41c-19323c4814d1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.672364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68cdf-6bf7-4152-870a-f009623fdd6e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.701358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.702172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.702470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.702853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.703681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:07.704023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.705483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.709287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.710291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.710774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.711229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.723233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 415/847] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:07.723824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.724404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.725719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:07.743454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:07.744415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:07.745272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:07.745272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:07.745272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:07.745272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:07.751904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 433/848] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:07.754247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.825958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3b37-be99-4e65-a2c2-6f2dbf346767 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.856570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852872e-4ed9-4776-9b02-1197bc0891dc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:07.864142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.865114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.865508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.865864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.875079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.876772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:07.893741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:07.895258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:07.896261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:07.899754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:07.900501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 416/849] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:07.901109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:07.901368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:07.901925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:07.902403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:07.903346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:07.903879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:07.905453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:07.922963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 434/850] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:07.924678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.005618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b497-b56e-481f-831b-9e4dd0cffd12 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.025827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685c02-4e77-43b1-bba9-02c362f0e513 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.040902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.041621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.041908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.042191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.043037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.043381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.044815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053c09a-8fd7-478f-87a9-094d88bfad9d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.067616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 417/851] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:08.067616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865263-960b-4b6e-9dcf-8c13a942e0be None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.067616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865263-960b-4b6e-9dcf-8c13a942e0be None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.067616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865263-960b-4b6e-9dcf-8c13a942e0be None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.067616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 418/852] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:08.069175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865263-960b-4b6e-9dcf-8c13a942e0be None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.073502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.074429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.074720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.075005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.082735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.084307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d0790658-3c82-4cbf-9b5b-5d997bc2877e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:08.099800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:08.100719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:08.102039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 435/853] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:08.102537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.102537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.102834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.119329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:08.120519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:08.185671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 436/854] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:08.186355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.203353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865263-960b-4b6e-9dcf-8c13a942e0be None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.241299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.241986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.242269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.242544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.285381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753499e-c33c-46e3-87e4-cda680eceb5a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.309233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.310736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.319831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.320584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.320872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.321212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.322067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.322384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.323819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.337265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 437/855] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:08.338170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.429879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 419/856] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:08.429879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.448013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ea0a-ae85-4415-95d2-8f737218c404 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.485587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.486441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.486735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.487018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.487740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.489268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:08.501048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:08.502099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:08.502930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:08.507697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 438/857] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:08.508626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.530889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500564-7e8f-4d1a-bcf1-ed760185640a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.566654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.567312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.567600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.567877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.568695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=c8fda86f5de6480f98993a7a5888112a) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.569006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.570459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.585733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 420/858] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/role_assignments?user.id=c8fda86f5de6480f98993a7a5888112a&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:08.585733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.629850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203c212-84c4-4821-9b1f-ab179f1015e8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.665636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.666447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.666732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.667010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.678367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.679870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.687777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eada86-ac36-4f4d-91bc-86ef0f19fb12 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-3c9b8268-bb61-4eb4-97e4-04a104a8c1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:08.698633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:08.699606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:08.700491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:08.700491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:08.700491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:08.700491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:08.700491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 439/859] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:08.701202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e66b9-a07d-4fa4-a593-09df31adc36d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.701423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e66b9-a07d-4fa4-a593-09df31adc36d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.701727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e66b9-a07d-4fa4-a593-09df31adc36d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.703241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 440/860] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:08.705323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e66b9-a07d-4fa4-a593-09df31adc36d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.730875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.731558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.731842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.732123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.732841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.733153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.734584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cadf-0785-44ba-a913-79d32a346077 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.739811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 421/861] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:08.741192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.741509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.741791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.760758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:08.761964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:08.825982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e66b9-a07d-4fa4-a593-09df31adc36d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.840500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 422/862] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:08.841432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.860805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.861843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.863216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.863712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.864956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.865748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.867879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:08.884385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 441/863] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:08.885686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:08.955131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf958ee-a61d-41d6-a848-93c9328d3b9a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.990584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:08.991248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:08.991534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:08.991810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:08.992312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62f81-dd57-47cb-b4b8-4e26792d81dd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:08.992511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:08.992816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:08.994206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.009863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 423/864] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:09.009863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:09.045385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.046512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.046898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.047291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.048063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.049626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:09.063169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:09.064258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:09.065080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:09.065986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 442/865] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:09.075260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:09.120295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ea625-87a5-469d-94f4-f18bd0d05886 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:09.156477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.157288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.157595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.157870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.165238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.166810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:09.187592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:09.188662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:09.189876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:09.190345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2ecad-0e94-4579-aab4-62861cbd0a1a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:09.194513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 424/866] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:09.195092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:09.236777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.238028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.238322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.238657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.240771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:09.240771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.241029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.250279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 443/867] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:09.251282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:09.324930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950d24-b95c-4656-922a-951364bb0680 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:09.360172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.360840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.361127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.361408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.362252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:09.363167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.364957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.376977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7042ede-05d5-4fb0-827b-8eb2099843ac None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:09.377710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 425/868] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:09.386089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:09.413000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.414010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.414430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.414879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.415795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:09.416248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.417794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57255-f943-468d-969b-6558a515ef43 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.423451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 444/869] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:09.504797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d07c3-c7dd-434c-a786-fd955663a3df None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:09.547529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:09.548380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:09.548760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:09.549135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:09.550323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=859e14db8cca4e4688078ef692a8b5e8) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:09.550697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:09.552252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f813d2d-e711-43e0-b83d-5ed9a91179ee None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:09.559385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 426/870] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:09 2022] GET /identity/v3/role_assignments?user.id=859e14db8cca4e4688078ef692a8b5e8&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:10.865344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae81e7-08a4-4bc3-898c-34ceb0360ebf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:10.865903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae81e7-08a4-4bc3-898c-34ceb0360ebf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:10.865903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae81e7-08a4-4bc3-898c-34ceb0360ebf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:10.867405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 445/871] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:10.872877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:10.873309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:10.873505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:10.890948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:10.892126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:10.959718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 427/872] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:10.989244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae81e7-08a4-4bc3-898c-34ceb0360ebf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:11.089976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae81e7-08a4-4bc3-898c-34ceb0360ebf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:11.124592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:11.125342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.125650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.125924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.126597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:11.128069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-43fddf5b-de33-4537-b384-4360cc016f2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:11.141338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:11.142521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:11.143341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 446/873] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:11.151545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:11.258419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1108-9798-473f-b996-e3aa167750aa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:11.295439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:11.296114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.296402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.296684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.297400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:11.297743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:11.299129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:11.305567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 428/874] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:11.310735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d60f-3d17-412e-a883-b7cb1fb8c8a8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.311046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d60f-3d17-412e-a883-b7cb1fb8c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.311330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d60f-3d17-412e-a883-b7cb1fb8c8a8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.312248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:11.312924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 447/875] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:11.317956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.318249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.318532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.338061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:11.339246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:11.413809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 448/876] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:11.431347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:11.435315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4c42-da11-43c1-ad14-35ee8bfbbc69 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:11.481674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:11.482903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.483371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.483881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.484792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:11.485743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:11.487589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb4628-54da-4ba0-9ef5-1fff0d324c57 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:11.494695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 429/877] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:11.547194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97af3-0c0c-4e3d-997f-78d64271fb85 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:11.586819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:11.587982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.588516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.588998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.590033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:11.591771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ccd2f-cd1f-4a3a-9c6d-ba0627f28eb5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:11.608000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 449/878] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:11 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:11.797676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ecc7-665d-424f-958f-6648a26bcc3e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.798373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ecc7-665d-424f-958f-6648a26bcc3e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.798862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ecc7-665d-424f-958f-6648a26bcc3e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.800783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 430/879] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:11.806397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.806686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.806959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.824283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:11.825452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:11.884052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7ef3-bba0-40ef-9687-b76d10f832a8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.884572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7ef3-bba0-40ef-9687-b76d10f832a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.884572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7ef3-bba0-40ef-9687-b76d10f832a8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.886225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 431/880] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:11.891341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:11.891633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:11.891914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:11.902141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 450/881] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:11.910391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:11.911567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:11.930102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:11.978135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 432/882] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:12.001401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.043969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4878c99-70b9-4510-8cc0-123da61a895d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.087053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.087651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.087938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.088220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.088948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:12.090381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:12.108389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 451/883] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:11 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:12.113530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52f86-0ac4-488e-ab3d-d8564208f8d5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.157985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.158803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.159085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.159562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.171501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:12.192419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:12.193451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:12.194328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 433/884] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:12.199953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.312036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b14fd6-77a0-4637-864c-079abe67aa02 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.345879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.346473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.347348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.347634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.348569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:12.348886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:12.350294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:12.358800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 452/885] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:12.364119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.472896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b5df-1768-4612-a07b-797d2f7c5cde None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.507496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.508306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.508592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.508872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.520481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:12.521968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:12.540163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:12.541092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:12.542013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:12.542013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:12.542013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:12.542013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:12.542013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 434/886] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:12.546951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.649462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6081f-2bad-4e27-bc80-d30414034d94 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.684008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.684716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.685006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.685287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.686047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:12.686359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:12.687740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:12.700637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 453/887] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:12.707050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.811538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628c7f0-fb91-43a0-9e2d-a79679c23078 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:12.848943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:12.849808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:12.850098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:12.850381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:12.858652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:12.860103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:12.875732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:12.876688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:12.877623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 435/888] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:12.883564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:12.992597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21e63-41e2-4010-85cf-79bc8717237d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:13.028595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:13.029731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.030213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.030721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.031754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:13.032258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:13.034257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:13.052810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 454/889] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:45:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:13.058248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:13.160591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a9906-d4c9-4b46-a531-65f1cf61f14b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:13.209086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:13.209771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.210053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.210332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.277229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:13.278641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:13.378849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 436/890] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:13.384668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:13.491333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fe460-ef9d-4653-ac8b-118e563d9396 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:13.527113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:13.527966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.528189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.528465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.539014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:13.540458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:13.558889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:13.559822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:13.560718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:13.560718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:13.560718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:13.560718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:13.560718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 455/891] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:13.567396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:13.671308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d716a6-81cb-4800-a656-d819796a286b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:13.704774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:13.705434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.705749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.706570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.707292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:13.707605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:13.708971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:13.720541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 437/892] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:13.726106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:13.836534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255523-5501-472d-91d4-a93d00fae438 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:13.871100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:13.871959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.872241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.872517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.880165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:13.881623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4e0f71d1-4aca-4571-a152-fa606e81135f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:13.895637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:13.896548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:13.897444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 456/893] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:13.904165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:13.950860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beedf47-75bb-449a-a925-71b6e3cfe35f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.951171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beedf47-75bb-449a-a925-71b6e3cfe35f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.951493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beedf47-75bb-449a-a925-71b6e3cfe35f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.953104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 457/894] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:13.958287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e1e0-e015-4236-a9c9-6cd678af781c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:13.958574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e1e0-e015-4236-a9c9-6cd678af781c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:13.958858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e1e0-e015-4236-a9c9-6cd678af781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:13.976223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f311e1e0-e015-4236-a9c9-6cd678af781c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:13.977398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f311e1e0-e015-4236-a9c9-6cd678af781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:14.010001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a95ba-f33d-48bb-a23e-ea99cbd4dc3b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.044858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 458/895] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:14.045574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.046263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a2f6-2a80-4a6f-98f7-957bc83b833c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.046597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a2f6-2a80-4a6f-98f7-957bc83b833c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.046873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a2f6-2a80-4a6f-98f7-957bc83b833c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.047174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.047650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.048126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.048422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 459/896] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:14.049392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.049807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.051306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.055516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.055799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.056071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.067707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 438/897] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:14.074328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.079414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:14.080573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:14.157582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 460/898] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:14.157582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.186016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988170a-150b-4d94-92b4-49217b7d9928 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.219654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.220692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.221165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.221440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.222366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] RBAC: Adding query filter params (role.id=9813d1b498b648e3ace70270ac62bec6, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=859e14db8cca4e4688078ef692a8b5e8) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.222671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.224097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.229487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 439/899] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/role_assignments?user.id=859e14db8cca4e4688078ef692a8b5e8&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9813d1b498b648e3ace70270ac62bec6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:14.230265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.272913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450075c-3554-42ce-9083-abd0a7e1bdb3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.313223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.314344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.314855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.315404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.317132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.318899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.341923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 461/900] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:14 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:14.357864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74dedb-0ac3-4642-bb4c-7003f4447b5a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.409019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.410553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.410842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.411124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.411817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.413274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-880125ac-764e-4f4a-8fbd-5e52cb597be1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:14.427420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:14.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:14.429301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 440/901] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:14.436373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.470846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c139-b4aa-4bb7-8cb6-3a3af6a9a3af None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.471189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c139-b4aa-4bb7-8cb6-3a3af6a9a3af None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.471424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c139-b4aa-4bb7-8cb6-3a3af6a9a3af None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.474616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 441/902] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:14.480296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.480579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.480865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.499175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:14.500410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:14.557111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6f6a-cf7d-4a9a-b102-d23634316862 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.586222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 442/903] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:14.594502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.595169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.596848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.596848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.596848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.596848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.598133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.605523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 462/904] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:14.608460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.611301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.716628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af5a04-9762-4d41-ad1d-dc4a503bd053 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.742045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6298c1-c583-482e-a61e-3858a8ab9d57 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.756866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.757732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.758401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.758693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.759699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.760015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.762142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.769391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 443/905] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:14.775227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.783827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.784768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.785121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.785560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.786335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.787787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:14.800256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:14.801188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:14.802027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 463/906] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:14.808286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.905622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10133a4-af44-4040-a2f4-0cecf0d665dc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.908145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7497d2-fb29-4d75-a722-3520104488fe None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:14.943889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.944720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.945102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.945492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.946365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.946764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.948326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.948622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:14.949286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:14.949756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:14.950038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:14.951148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] RBAC: Adding query filter params (interface=public, service_id=e08b4d49e3854256b74b64dd318414f9, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:14.951501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:14.953153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:14.954204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 464/907] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:14.959963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:14.969667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 444/908] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/endpoints?service_id=e08b4d49e3854256b74b64dd318414f9&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:14.970496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:15.095531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9692bf-74a5-4cc4-97d5-5496fe516f8f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:15.098600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f047-9d8a-4f8a-ad20-a34153f93192 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:15.136143 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:15.137171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:15.137463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:15.137852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:15.138636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:15.140098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:15.140571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:15.141483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:15.142116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:15.142471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:15.143644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:15.144466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:15.145938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:15.146649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 445/909] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:45:15.161098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 465/910] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:15.162592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:15.277700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5fe2-3f06-4692-abb7-281bef7b1c80 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:15.313272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:15.314249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:15.314703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:15.315133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:15.316936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] RBAC: Adding query filter params (interface=public, service_id=5031349509f7489c8303d7fa9cc2846c, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:15.317415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:15.319118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ed1a-4a1d-4f6c-bcae-53299b320fb0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:15.328977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 446/911] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:15 2022] GET /identity/v3/endpoints?service_id=5031349509f7489c8303d7fa9cc2846c&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:15.331571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:15.437836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49d6b-79fb-4b99-a7e7-1a73211028a1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:15.473654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:15.474592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:15.475033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:15.475508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:15.476361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:15.477939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cb6e-26c2-4feb-ae8a-5862e8b9861a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:15.487732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 466/912] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:15 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:45:16.521302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc03c-4a74-40bc-894c-c23f7adc21bb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.521888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc03c-4a74-40bc-894c-c23f7adc21bb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.521888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc03c-4a74-40bc-894c-c23f7adc21bb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.523634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 447/913] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:16.529541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203efe-9df4-4ed4-865f-bc94d15ed7ee None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.530087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203efe-9df4-4ed4-865f-bc94d15ed7ee None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.530087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203efe-9df4-4ed4-865f-bc94d15ed7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.547281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1f203efe-9df4-4ed4-865f-bc94d15ed7ee None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:16.550464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1f203efe-9df4-4ed4-865f-bc94d15ed7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:16.617347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 467/914] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:16.640582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc03c-4a74-40bc-894c-c23f7adc21bb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:16.699612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb06f-ed95-491a-b047-ffe01e28a4ba None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.699945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb06f-ed95-491a-b047-ffe01e28a4ba None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.700368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb06f-ed95-491a-b047-ffe01e28a4ba None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.701647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 468/915] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:16.707451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.707798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.708090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.727308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:16.728855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:16.753846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc03c-4a74-40bc-894c-c23f7adc21bb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:16.795923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:16.796860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.797150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.797430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.798940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 469/916] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:16.811090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:16.821323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:16.823559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:16.825718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:16.827267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:16.827422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 448/917] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:16.830100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:16.942875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15eea-418c-4c15-b985-9a800b9fbd50 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:16.944490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ca6c-a921-4d9b-a1bc-5469be2cfd24 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:16.980492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:16.981553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.982060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.982571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.983518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:16.984053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:16.985161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:16.985952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:16.986074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:16.986263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:16.986544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:16.987261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:16.988836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.000483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 449/918] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:17.001632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:17.004864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:17.005916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:17.006766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 470/919] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:17.012097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.106799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8421d-adae-4314-89f3-ed6c19162783 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.124214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8661-e99d-419c-a4f5-fb4f399f2c16 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.142033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.143173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.144210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.144719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.155822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.157721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.159982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.160658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.160942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.161457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.161973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:17.162282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.163642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.168839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 471/920] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:17.175981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:17.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:17.187037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:17.187895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:17.187895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:17.187895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:17.187895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:17.190762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 450/921] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:17.196241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.304313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121fe8b-087e-455b-a3c4-5e0bd534f157 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.308824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f600-df60-4480-ae0c-dc2cd7c76648 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.338279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.338896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.339182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.339462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.340195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:17.340507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.341971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.349495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 472/922] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:17.354495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.358032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.358531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.358823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.359106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.360725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:17.360725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.361615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.380974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 451/923] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:17.381951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.462906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e326-f829-4514-a4f0-b66858b09921 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.483333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46ce7-69bf-44ff-be62-6f761c13c539 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.497686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.498759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.499265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.499748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.500754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] RBAC: Adding query filter params (interface=public, service_id=ae02520ebada4b45a55598fa0503377d, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:17.501277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.503418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.513801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 473/924] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/endpoints?service_id=ae02520ebada4b45a55598fa0503377d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:17.515837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.521827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.522664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.522953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.523366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.531913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.533520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5840f070-e915-4bba-bec7-ddada83c5a85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:17.552297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:17.553249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:17.554226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:17.558237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 452/925] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:17.559373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5a49-b2e8-463a-93c8-460acb00a1c7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.559665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5a49-b2e8-463a-93c8-460acb00a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.559950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5a49-b2e8-463a-93c8-460acb00a1c7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.561346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 453/926] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:17.565435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a5a49-b2e8-463a-93c8-460acb00a1c7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.623337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a88a67-952a-48b8-94d3-7137055043b1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.657607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.658280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.658568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.659683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.660274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.661672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f23c4-6c70-4de4-a6ab-4f86a73631da None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.677884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 474/927] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:45:17.677884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d0fb-ca29-496a-a04f-2213574575fe None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.677884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d0fb-ca29-496a-a04f-2213574575fe None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.677884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d0fb-ca29-496a-a04f-2213574575fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.679335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a5a49-b2e8-463a-93c8-460acb00a1c7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.695085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-79a5d0fb-ca29-496a-a04f-2213574575fe None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:17.696285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-79a5d0fb-ca29-496a-a04f-2213574575fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:17.726823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.727669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.727955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.728581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.729766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:17.730082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.732687 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.758550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 454/928] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:17.764512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.790978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 475/929] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:17.802295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad714-7602-4439-9bca-df49e0945a89 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.802764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad714-7602-4439-9bca-df49e0945a89 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.803051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad714-7602-4439-9bca-df49e0945a89 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.805420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 476/930] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:17.813371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.813797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.814225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.832523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:17.834131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:17.891160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdca1e-357d-4582-9265-808ffefc682d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:17.910511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 477/931] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:17.911365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:17.930184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:17.931305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:17.931597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:17.931883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:17.945229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:17.947315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:17.966437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:17.967368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:17.968272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:17.968272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:17.968272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:17.968272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:17.968272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 455/932] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:17.969029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.023748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9cd75-d901-46d8-933b-4c9bb4ac745e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.058085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.059373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.059863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.060359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.061226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.062827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.070617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8a9b-975e-488e-8252-4a0ec7486c50 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:18.074740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:18.075722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 05:45:18.076587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:18.081652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 478/933] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:18.082363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.105644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.106467 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.106754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.107031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.107684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.109055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:18.122282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:18.123455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:18.124269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 456/934] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 11 05:45:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:18.125087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.190365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129916cc-cbe3-4ad2-b741-b98fbf217008 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.224492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.225156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.225572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.225858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.226587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.226900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.228268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.239659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8dce1-0c2d-4a9b-ba77-713c5a0d0b2b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.239838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 479/935] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.240536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.278776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.279450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.279756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.280080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.280821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.281136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.282538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.288242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 457/936] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.289093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.347772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae35b9-e0e8-44a8-bfeb-13cd775338b2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.380847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.381536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.381829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.382111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.382818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.383128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.384502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.389625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 480/937] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.390329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.399780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ebb-d887-4571-b0de-8f0349b709ae None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.434156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.435246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.435674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.436080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.443615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.445250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:18.459954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:18.461020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:18.462126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:18.463886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 458/938] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:18.464796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.506552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dc05-beef-4c33-94cf-665097703eee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.541169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.541857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.542139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.542412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.543118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.543424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.544784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.554184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 481/939] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.554184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.568330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982c7d-988a-402f-a632-177c38ab1dce None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.601037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.601723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.602006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.602284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.602981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.603288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.604648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.609384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 459/940] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.610162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.655586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07951744-9bd7-4df2-88c8-439401bbea1f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.688619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.689190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.689507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.689780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.690848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:18.691156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.692569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.708714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 482/941] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:18.708714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.712183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732603-9031-474a-bd66-2fc3702147bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.744997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.745693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.745977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.746254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.746989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.748348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.769094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 460/942] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:18.770337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:18.829115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca93a-b58b-4cc7-8399-8413de2d8245 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.895837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.896911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.897456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.897973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.899042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.900695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b1f89-516b-4aec-84d1-e05b3f0cb1f2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.902827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f3a3-b6fd-4705-867e-135ad946c6c3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:18.927966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 483/943] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:18.962535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65919abe-2745-4439-8455-e71a9699311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:18.963372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919abe-2745-4439-8455-e71a9699311c None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:18.963661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919abe-2745-4439-8455-e71a9699311c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:18.963944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919abe-2745-4439-8455-e71a9699311c None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/859e14db8cca4e4688078ef692a8b5e8/roles/9813d1b498b648e3ace70270ac62bec6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:18.966394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65919abe-2745-4439-8455-e71a9699311c None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=859e14db8cca4e4688078ef692a8b5e8, role_id=9813d1b498b648e3ace70270ac62bec6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:18.967879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65919abe-2745-4439-8455-e71a9699311c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:18.983868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 461/944] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:18 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/859e14db8cca4e4688078ef692a8b5e8/roles/9813d1b498b648e3ace70270ac62bec6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:19.934498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1b68-12a6-46d6-92ee-ea1402722609 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:19.935019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1b68-12a6-46d6-92ee-ea1402722609 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:19.935098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1b68-12a6-46d6-92ee-ea1402722609 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:19.936637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 484/945] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:19.942719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f132-228f-4cd6-9460-543708acea63 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:19.943137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f132-228f-4cd6-9460-543708acea63 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:19.943305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f132-228f-4cd6-9460-543708acea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:19.959814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c662f132-228f-4cd6-9460-543708acea63 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:19.960998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c662f132-228f-4cd6-9460-543708acea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:20.029034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 462/946] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:20.052591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df1b68-12a6-46d6-92ee-ea1402722609 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:20.159044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df1b68-12a6-46d6-92ee-ea1402722609 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:20.204255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:20.204992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:20.205277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:20.205585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:20.207087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:20.208473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:20.220627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:20.222417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:20.223255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 485/947] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:20.228361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f132-228f-4cd6-9460-543708acea63 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:20.327326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f132-228f-4cd6-9460-543708acea63 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:20.361044 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:20.361742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:20.362559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:20.363178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:20.363605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:20.363916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:20.365282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:20.370278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 463/948] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:20.375826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:20.474420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b466a-46e3-472d-9069-60175ec34840 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:20.507909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:20.508573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:20.508865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:20.509148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:20.509884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:20.510197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:20.511572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f8cd-e0df-47dc-9917-624a97623ce9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:20.517020 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 486/949] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:20.522681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:20.629425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867eb4-7f2a-4074-8655-156464902fb0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:20.664855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:20.665545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:20.665834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:20.666123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:20.666877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:20.668243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6f140-2a93-421f-a281-04bac2f629b2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:20.688959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 464/950] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:21.235370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a89ac-ba50-444a-b56b-b35d95d17f87 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.235370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a89ac-ba50-444a-b56b-b35d95d17f87 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.235997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a89ac-ba50-444a-b56b-b35d95d17f87 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.237728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c96af-b52a-48a6-aee3-45f3bd600abb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.238289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 487/951] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:21.238789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c96af-b52a-48a6-aee3-45f3bd600abb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.239328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c96af-b52a-48a6-aee3-45f3bd600abb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.241131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 465/952] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:21.243153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32a5c-0790-4c27-9322-4c6168377d05 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.243447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32a5c-0790-4c27-9322-4c6168377d05 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.243729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32a5c-0790-4c27-9322-4c6168377d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.247300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.247593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.247877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.263661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d1c32a5c-0790-4c27-9322-4c6168377d05 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:21.265168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d1c32a5c-0790-4c27-9322-4c6168377d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:21.265747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:21.266915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:21.337797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 488/953] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:21.339550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07413-dcf4-4753-bf60-654a30f8c03f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.339897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07413-dcf4-4753-bf60-654a30f8c03f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.340241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07413-dcf4-4753-bf60-654a30f8c03f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.345559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 489/954] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:21.347372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.347701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.348061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.348966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 466/955] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:21.365993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.373377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:21.374634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:21.441216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 490/956] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:21.446057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.463122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc840-4a53-4ecd-b952-b02712361923 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.499646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.501014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.501771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.502235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.503782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:21.505894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:21.508486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING keystone.server.flask.common [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 05:45:21.529926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.sql.core [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 05:45:21.529926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 05:45:21.529926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [parameters: {'id': '344114492fab4d70a37c04e4c559e9ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 05:45:21.529926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80069) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 344114492fab4d70a37c04e4c559e9ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 344114492fab4d70a37c04e4c559e9ff. May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:45:21.538045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 05:45:21.538955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application yield resource May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.rollback() May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.force_reraise() May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise self.value May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application session.commit() May 11 05:45:21.539945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._prepare_impl() May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.flush() May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._flush(objects) May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application compat.raise_( May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application flush_context.execute() May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 05:45:21.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rec.execute(self) May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 05:45:21.547425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:45:21.549400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [parameters: {'id': '344114492fab4d70a37c04e4c559e9ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.552169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:21.554122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 344114492fab4d70a37c04e4c559e9ff. May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 467/957] 10.222.0.44 () {60 vars in 1140 bytes} [Wed May 11 05:45:21 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:21.556315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.557767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fb6a4-4353-41cf-bb12-f626ec3c0e02 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.589400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.590237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.590573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.590841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.600601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:21.608767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:21.609888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:21.610905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:21.615232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 491/958] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:21.616109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.655618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174f2b-f51b-441c-9629-f584170e57f6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.688462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.689244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.689552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.689829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.691189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:21.692818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:21.704120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:21.705285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:21.706299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 468/959] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:21.707090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.718452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4170-e29e-4feb-9c7c-1a3ae1e70caf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.754968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.755761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.756054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.756329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.763295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:21.764753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:21.779338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:21.780260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:21.781148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 492/960] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:21.781706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.807527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d363a3-a348-46a2-8490-65e32ebefebf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.843586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.844588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.844887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.845333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.847037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:21.847529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:21.849069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:21.868128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 469/961] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:21.868128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.885932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee886b3-9066-434e-b178-b6c81184f6ae None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:21.920790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:21.921454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:21.921786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:21.922053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:21.922760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:21.923072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:21.925111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:21.934849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 493/962] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:21.934849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:21.970510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7889b-0241-40ea-9a81-64610dd7a308 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.003049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.003777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.004062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.004344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.005182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:22.005526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.007027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.033743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 470/963] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:22.033743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:22.044867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0317c-5a1c-4215-8d2a-e15b6e2ba060 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.091743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.092727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.093160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.093452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.108583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.110095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:22.134545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:22.135526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:22.136391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:22.136391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:22.136391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:22.136391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:22.141419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 494/964] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:22.143807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432764-792b-4d6d-afe9-12f86f417f7c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.145055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:22.190297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.190975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.191256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.191533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.192257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:22.194091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.195381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.204398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 471/965] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:22.290277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d1998-c2c4-47d8-98a8-523eedda3b61 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.332466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.333437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.333899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.334323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.335226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:22.335688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.337268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.351425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 495/966] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:22.357413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:22.466686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18603-3409-4bc6-a72d-f446dca24595 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.501606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.502435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.503190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.503190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.515783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.517316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:22.533404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:22.535541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:22.536468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 472/967] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:45:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:22.541408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:22.642334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839691-3f82-4b17-9a77-1b080271aeca None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.678231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.678902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.679185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.679460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.680289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:22.680595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.682077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8b45-1f22-45ee-ad5c-0f88e527bc91 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.704998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 496/968] 10.222.0.44 () {56 vars in 1149 bytes} [Wed May 11 05:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:22.707084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:22.812255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa78ff-d671-4ba9-ac04-a7a2d6a787ba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:22.846657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:22.847312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.847593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.847869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.915924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:22.917438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:22.953214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944221-4a80-4953-a8b5-028c35c7deb4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.953552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944221-4a80-4953-a8b5-028c35c7deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.953789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944221-4a80-4953-a8b5-028c35c7deb4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.955265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 497/969] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:22.960644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:22.961177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:22.961730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:22.983461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:22.984789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:23.045209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 473/970] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:23.047389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.061609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 498/971] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:23.081886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.163288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da636-5e1b-4e68-a97a-ba75db850b63 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.182238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e036beb-cff4-4882-bb53-f3830626c8a1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.208973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.210097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.210532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.211011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.216381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.217180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.217513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.217807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.218463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.219832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.223442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.225049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:23.232278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:23.233459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:23.234618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:23.237994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 499/972] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:23.240370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:23.247392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:23.248511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:23.249536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:23.249536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:23.249536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:23.249536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:23.251326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 474/973] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:23.257088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.344220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc89f-612e-4c56-a635-8d8f216e465a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.363796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb6d3-81c7-4507-bb46-7e44fbcf92de None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.380412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.380931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.381219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.381527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.382264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.382579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.383909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.389524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 500/974] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:23.398532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.405835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.406750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.407220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.408096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.409694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.410575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.412613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.428990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 475/975] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:23.434919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.510320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203f2c-a38b-4e87-a372-46d8a66cf75f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.550190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572831a-6ef0-44f2-9738-6be220b79f64 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.551386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.552280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.553369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.553683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.554401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.554716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.556097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.565552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 501/976] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:23.569456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.589645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.590461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.590791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.591065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.598540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.599928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:23.614507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:23.615415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:23.616383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:23.620440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 476/977] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:23.621709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.684952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9189-031b-49b6-a8c4-3c2f0d1bda1e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.719836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.720870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.721386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.721901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.722710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55838a5-913a-429b-9f00-db14c27520fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.723212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] RBAC: Adding query filter params (interface=admin, service_id=ae02520ebada4b45a55598fa0503377d, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.723727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.725297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.735269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 502/978] 10.222.0.44 () {56 vars in 1249 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/endpoints?service_id=ae02520ebada4b45a55598fa0503377d&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:23.736371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.758065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.758780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.759067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.759346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.760190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.760502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.762357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.780046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 477/979] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:23.781364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:23.838869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188baa-a033-4a36-b04f-25db67219917 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.873323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.874360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.874850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.875327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.876202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.877861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f4102-bcce-4dde-a23b-9176db08ab3b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.882583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2558-5251-4b52-8ddc-21dc7c4c9b33 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:23.893788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 503/980] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:45:23.922295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:23.922975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:23.923264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:23.923554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:23.924942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] RBAC: Adding query filter params (role.id=9813d1b498b648e3ace70270ac62bec6, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=859e14db8cca4e4688078ef692a8b5e8) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:23.925329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:23.926952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa86b9-c6a6-4f40-b647-0ede2c6f4620 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:23.941749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 478/981] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:23 2022] GET /identity/v3/role_assignments?user.id=859e14db8cca4e4688078ef692a8b5e8&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9813d1b498b648e3ace70270ac62bec6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:24.389418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d986-bbd8-4c05-a488-0bcf640fc47c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.389951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d986-bbd8-4c05-a488-0bcf640fc47c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.390052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d986-bbd8-4c05-a488-0bcf640fc47c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.391595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 504/982] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:24.397128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc31df-7b41-4ddf-ac1f-fe798de5c089 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.397570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc31df-7b41-4ddf-ac1f-fe798de5c089 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.397764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc31df-7b41-4ddf-ac1f-fe798de5c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.414962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3bc31df-7b41-4ddf-ac1f-fe798de5c089 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:24.416451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3bc31df-7b41-4ddf-ac1f-fe798de5c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:24.489614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 479/983] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:24.514132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d986-bbd8-4c05-a488-0bcf640fc47c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:24.537539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ed76-f9fa-4cb1-ac4e-0f63f752c4b0 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.537853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ed76-f9fa-4cb1-ac4e-0f63f752c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.538113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ed76-f9fa-4cb1-ac4e-0f63f752c4b0 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.539741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 480/984] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:24.544664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.544955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.545236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.562437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:24.563633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:24.617833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d986-bbd8-4c05-a488-0bcf640fc47c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:24.637735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 481/985] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:24.651809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:24.652469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.652752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.653026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.653758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:24.655180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:24.656474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING keystone.server.flask.common [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 05:45:24.657981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:24.669707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.sql.core [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 05:45:24.669707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 05:45:24.669707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [parameters: {'user_id': 'baa7e5592e824c8e8d403eb9d60e9f63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 05:45:24.669707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80070) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application conn.query(q) May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result.read() May 11 05:45:24.692189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:45:24.693720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application next(self.gen) May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application yield resource May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application next(self.gen) May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.session.rollback() May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.force_reraise() May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise self.value May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application session.commit() May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 05:45:24.694955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._prepare_impl() May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.session.flush() May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._flush(objects) May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application compat.raise_( May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application flush_context.execute() May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rec.execute(self) May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 05:45:24.696891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 05:45:24.698750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result = self._query(query) May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application conn.query(q) May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result.read() May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 05:45:24.710430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [parameters: {'user_id': 'baa7e5592e824c8e8d403eb9d60e9f63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:24.712014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 05:45:24.713640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 505/986] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 11 05:45:24 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:24.715497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:24.780257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ebda9-7d0b-4184-9dbe-249f9acf3f19 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:24.818763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:24.819636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.820007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.820359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.821169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:24.822648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:24.824446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b032ea8-ae2a-470e-a2b5-8efbb94cf70c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:24.840574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 482/987] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:24 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:24.877632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:24.878467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:24.878807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:24.879156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:24.888144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:24.889774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bddd9c4e-89a0-4b9a-b61f-5a4fd67d9a65 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:24.906371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:24.908383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:24.910307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 506/988] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:24.914260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:25.022993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9245b-42de-47c6-8da4-6d83bf7bb74c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:25.059499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:25.060097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:25.060383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:25.060664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:25.061500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:25.061810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:25.063239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51fbd-c402-473f-87a6-a19caa820360 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:25.107673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 483/989] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 11 05:45:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:26.192983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b1ca-e11e-4d74-b968-5161de91a67f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.193587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b1ca-e11e-4d74-b968-5161de91a67f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.193587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b1ca-e11e-4d74-b968-5161de91a67f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.195061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 507/990] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:26.200092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8ff28-ab9f-439e-86e1-ccc9cf4825f7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.200548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8ff28-ab9f-439e-86e1-ccc9cf4825f7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.200695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8ff28-ab9f-439e-86e1-ccc9cf4825f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.217857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1dc8ff28-ab9f-439e-86e1-ccc9cf4825f7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:26.219012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1dc8ff28-ab9f-439e-86e1-ccc9cf4825f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:26.282659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 484/991] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:26.293795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3173-5194-40c9-a33d-66018aea06b5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.294090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3173-5194-40c9-a33d-66018aea06b5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.294375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3173-5194-40c9-a33d-66018aea06b5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.295849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 508/992] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:26.301299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.301652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.301937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.304938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3173-5194-40c9-a33d-66018aea06b5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.319436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:26.320617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:26.387891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 485/993] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:26.408464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3173-5194-40c9-a33d-66018aea06b5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.410490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.442407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.443147 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.443435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.444073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.444739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.446147 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:26.461631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:26.462635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 05:45:26.463511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:26.464949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 509/994] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:26.470914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.513716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c111b5d-a8df-41ac-ac0a-bef3df819429 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.555421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.556226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.556733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.556842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.557424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.558841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.570879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fd93-bfcd-42a5-bdf1-27869141f8e5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:26.571152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:26.572082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:26.572936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 486/995] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:26.578593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.606098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.606767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.607079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.607340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.608046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:26.608360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.609771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.615536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 510/996] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:26.620918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.678951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07eacc-f2a5-46ef-a8c4-5c366153e7d4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.712842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.713801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.714239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.714518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.715217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:26.715525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.716893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.722451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 487/997] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:26.724708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c2c7-fdae-46e9-b965-80747e9824d3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.728363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.758035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.758697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.758976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.759253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.759952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:26.760256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.762022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.771336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 511/998] 10.222.0.44 () {56 vars in 1122 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:26.772555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:26.831196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af106-cc7f-4132-ba38-ccb413335b61 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.865206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433334-0030-4b89-88eb-41421db711dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.866221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433334-0030-4b89-88eb-41421db711dd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.866684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433334-0030-4b89-88eb-41421db711dd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.867137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433334-0030-4b89-88eb-41421db711dd None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.868011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433334-0030-4b89-88eb-41421db711dd None admin] RBAC: Adding query filter params (type=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:26.868511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433334-0030-4b89-88eb-41421db711dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.870097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433334-0030-4b89-88eb-41421db711dd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.871881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f406-d483-419d-bea9-03e83d70dac2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:26.874853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 488/999] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:26.907077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:26.907755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:26.908036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:26.908308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:26.909663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:26.911138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e539d-0845-4023-97e5-139515620fe4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:26.937504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 512/1000] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:27.158639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b4b-b430-488b-8c73-1f090b0d3a9d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.159494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b4b-b430-488b-8c73-1f090b0d3a9d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.159727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b4b-b430-488b-8c73-1f090b0d3a9d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.161248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 489/1001] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:27.166544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.166838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.167120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.188170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:27.189901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:27.259912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 513/1002] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:27.282226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1b4b-b430-488b-8c73-1f090b0d3a9d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:27.379908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1b4b-b430-488b-8c73-1f090b0d3a9d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:27.415075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:27.415801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.416086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.416364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.417013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:27.418411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:27.430524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:27.431535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:27.432418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 490/1003] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:27.437546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:27.535977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb015d6-6755-428c-8e8f-93f248a7fe42 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:27.568334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:27.569000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.569282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.569583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.570289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:27.570596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:27.571961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:27.581267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 514/1004] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:27.582370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:27.680082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421e5a1-7e5c-48ea-a86e-2ff67b0fe93a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:27.712622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:27.713287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.713730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.714098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.714729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:27.715042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:27.716409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:27.725552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 491/1005] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:27.727396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:27.822670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070df8-7d60-41a6-8be5-da4e66610800 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:27.854743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:27.855400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.855683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.855961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.856741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] RBAC: Adding query filter params (interface=public, service_id=56343b2bee574152af2a480a4de29ad1, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:27.857051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:27.858444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbe6f-2157-41ac-91e9-6bfebc07f1a0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:27.868364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 515/1006] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:27 2022] GET /identity/v3/endpoints?service_id=56343b2bee574152af2a480a4de29ad1&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:27.869948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:27.964818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ceda2-5ff2-4f5f-a002-c1a4cee53968 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:27.997290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:27.997981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:27.998268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:27.998544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:27.999214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:28.000569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203b727-b2a6-45a5-be2c-dbaa3aa65164 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:28.013790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 492/1007] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:27 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:45:29.147975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4c0f-cbc2-4f24-bc90-cc1cf0907560 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.148549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4c0f-cbc2-4f24-bc90-cc1cf0907560 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.148549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4c0f-cbc2-4f24-bc90-cc1cf0907560 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.149975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 516/1008] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:29.155208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.155588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.155766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.170742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac478-777d-417f-9e19-d39fa1c3e169 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.171048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac478-777d-417f-9e19-d39fa1c3e169 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.171294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac478-777d-417f-9e19-d39fa1c3e169 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.172571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:29.173619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 517/1009] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:29.173742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:29.178569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.178855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.179137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.200423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:29.201646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:29.245007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 493/1010] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:29.269562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:29.272532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 518/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:29.296476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:29.368641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83a876-21ea-4658-9312-804aebc1e3a3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:29.391069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29ad8-5752-4c93-ab28-a8703edceab9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:29.401715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:29.402311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.402591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.402881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.403573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:29.404929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:29.420783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 494/1012] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:29 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:29.433720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:29.434529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.434809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.435083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.436338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:29.437837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9da0-54bf-4637-b184-64dc50039fdc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:29.439820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 519/1013] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:29.445694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:29.550661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cd29-1291-4743-8f4d-6665981729ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:29.586692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:29.587375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:29.587663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:29.587943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:29.588677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:29.590182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9664a9b-b669-4b10-a979-5df00e40fe7d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:29.621105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 495/1014] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:29 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:30.268223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35a15-af63-4eea-9b4f-c33dee8bc601 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.268735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35a15-af63-4eea-9b4f-c33dee8bc601 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.268813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d35a15-af63-4eea-9b4f-c33dee8bc601 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.270232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 520/1015] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:30.275393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.275776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.275948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.293867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:30.295054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:30.359943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 496/1016] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:30.382872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d35a15-af63-4eea-9b4f-c33dee8bc601 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:30.480354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d35a15-af63-4eea-9b4f-c33dee8bc601 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:30.513857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:30.514655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.514938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.515214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.515871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:30.517231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:30.529262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:30.530247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 05:45:30.531103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:30.532538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 521/1017] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:30.536438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:30.634748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f413-b036-49a5-aa99-03061eebc30e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:30.667748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:30.668421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.668705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.668980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.669717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] RBAC: Adding query filter params (name=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:30.670026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:30.671396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:30.681186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 497/1018] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:30.682695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:30.779836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8869-5450-47d1-89c9-2d7fe937b121 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:30.813297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:30.813982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.814263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.814538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.815897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:30.816221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:30.817759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df27374-8822-4462-8dac-18a35fc9477c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:30.827330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 522/1019] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 11 05:45:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:30.828896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:30.928593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f839d1-059d-46e6-a9e0-7d851504acda None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:30.962096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:30.962762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:30.963051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:30.963332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:30.964064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:30.965438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9b03a-73fe-4819-bf74-f951e78f3406 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:30.993511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 498/1020] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:45:31.672586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8e5e-0095-4db9-bd4d-144031dd08a4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:31.673112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8e5e-0095-4db9-bd4d-144031dd08a4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:31.673112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8e5e-0095-4db9-bd4d-144031dd08a4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:31.675294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 523/1021] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:31.681096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c892c-e76d-41a5-9f5c-41949d68ea79 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:31.682078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c892c-e76d-41a5-9f5c-41949d68ea79 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:31.682579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c892c-e76d-41a5-9f5c-41949d68ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:31.701530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b03c892c-e76d-41a5-9f5c-41949d68ea79 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:31.703125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b03c892c-e76d-41a5-9f5c-41949d68ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:31.793493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 499/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:31.808203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8e5e-0095-4db9-bd4d-144031dd08a4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:31.879616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81e85-36d2-4043-aead-70ed0176c219 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:31.879899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81e85-36d2-4043-aead-70ed0176c219 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:31.880260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81e85-36d2-4043-aead-70ed0176c219 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:31.881563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 500/1023] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:31.888102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:31.888388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:31.888662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:31.905405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:31.906609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:31.920257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8e5e-0095-4db9-bd4d-144031dd08a4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:31.959220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:31.960056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:31.960179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:31.960461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] PATH_INFO: `/v3/services/image` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:31.961115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:31.962528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:31.975216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:31.981411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:31.982495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 524/1024] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 11 05:45:31 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:31.983471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:31.996167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 501/1025] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:32.025819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:32.095112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db884b-14d5-4d21-83ec-84e480e59f51 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.128076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.128736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.129015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.129288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.130014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:32.130318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.131682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.136357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 525/1026] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:32.137793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0b41-cd11-427c-8d91-fb2d1f635e01 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.142012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:32.173078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.173916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.174728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.175004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.176694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.178159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.179783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 502/1027] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:32.186768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:32.247267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2162c-b049-4cf1-9be8-43219805a6b3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.281348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.282055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.282340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.282619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.283325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] RBAC: Adding query filter params (type=image) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:32.283695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.285213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.286870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355baa04-7d71-4e45-bcd1-03631b82ea8f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.292488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 526/1028] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:32.295722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:32.323154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.323831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.324116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.324390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.325088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.326556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.348703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 503/1029] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:45:32 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:32.400366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88402d57-c655-4b32-b467-e2a87581c9ca None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.436186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.436861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.437144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.437420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.438265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] RBAC: Adding query filter params (interface=public, service_id=2671a8eb9e294fb09325dcaf0bf1e9d6, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:32.438577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.440057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a0166-64d2-49c5-bd98-fe36d1bafa29 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.450462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 527/1030] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:45:32 2022] GET /identity/v3/endpoints?service_id=2671a8eb9e294fb09325dcaf0bf1e9d6&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:32.452166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:32.558247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515404e2-1d7a-40ef-a560-d20f2100951a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:32.594915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:32.595578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:32.596387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:32.596669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:32.597347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:32.598759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1bb0-1eb2-4298-a53c-47df0bd8999a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:32.605699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 504/1031] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:45:32 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:45:33.339560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078e3c-63bb-4d17-beed-f02ed604c10a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:33.340074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078e3c-63bb-4d17-beed-f02ed604c10a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:33.340154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078e3c-63bb-4d17-beed-f02ed604c10a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:33.341524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 528/1032] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:33.347855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:33.348300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:33.348473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:33.364725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:33.365946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:33.430341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 505/1033] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:33.454031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd078e3c-63bb-4d17-beed-f02ed604c10a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:33.554541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd078e3c-63bb-4d17-beed-f02ed604c10a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:33.587186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:33.587989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:33.588318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:33.588539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:33.599462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:33.607832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:33.608756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:33.609606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:33.615567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 529/1034] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:33.617670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:33.713235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88f520-0145-47bb-bb58-c546683f75ff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:33.747910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:33.748579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:33.748864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:33.749141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:33.749922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:33.750236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:33.751634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:33.764173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 506/1035] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:33.765444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:33.862378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc14d5-4216-48bc-a6e8-7ab874c894f3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:33.895208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:33.896004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:33.896289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:33.896568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:33.906184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:33.907638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:33.925155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:33.926334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:33.932229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:33.932229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:33.932229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:33.932229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:33.932229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 530/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:33.932514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.029026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa902f6d-4e44-4846-bf21-9095835674da None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.062147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.062808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.063099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.063384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.064112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:34.064424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:34.065883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:34.077732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 507/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:34.083343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.182477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663a62-56cb-434e-a546-b82171706528 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.215870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.217037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.217579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.218066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.226735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:34.228449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:34.243643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:34.244616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:34.245637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:34.249607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 531/1038] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:34.252824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.353952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54e881-891a-4bc4-b4d1-00df2c3d248c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.388503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.389182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.389489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.389775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.390619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:34.390940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:34.392380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ad1e8-f4d8-4061-aac1-c11ee3c2587f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:34.410817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 508/1039] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:34.416376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.520229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb250-cb1d-4b94-957b-81c8ccecd8ee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.553781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.554432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.554719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.554997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.619421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:34.620811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:34.630924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582330-fc1d-495d-9b52-062a32aa1366 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.631205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582330-fc1d-495d-9b52-062a32aa1366 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.631490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582330-fc1d-495d-9b52-062a32aa1366 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.633589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 509/1040] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:34.639001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.639451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.639568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.657080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:34.659156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:34.722058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 532/1041] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:34.725177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 510/1042] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:34.734483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.747622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.832344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084dcd-6467-4007-8ffb-9f098d231f9a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.844651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3c2d-4f1a-4d19-9d86-0cff912921ef None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.864728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.865541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.865825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.866108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.875594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:34.876600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:34.877501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:34.878016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.878301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.878581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.888466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:34.895730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:34.896584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:34.897456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:34.897456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:34.897456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:34.897456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b0a47cf5-0503-4059-b82c-1fe43fc3f970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:34.897866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:34.898708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 511/1043] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:34.899518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83540-1e85-43d7-a86f-4d581afc0f97 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:34.900397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83540-1e85-43d7-a86f-4d581afc0f97 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:34.900397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83540-1e85-43d7-a86f-4d581afc0f97 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:34.901200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 512/1044] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:34.901649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 533/1045] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:34.903642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83540-1e85-43d7-a86f-4d581afc0f97 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.904679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:34.997087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc31ea-42bb-485b-9bd9-42ad9e141ea9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:34.997931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83540-1e85-43d7-a86f-4d581afc0f97 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.030339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.031002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.031151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.031272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.031551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.031849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.032137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.032289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.032410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.032596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.033114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.033445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.034024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28ef6b-70e3-45d8-b894-c9f6f0b41384 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.034812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.042027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 534/1046] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.043305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.043600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.043881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.046181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 513/1047] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.047658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.060284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:35.061485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:35.125017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 535/1048] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:35.126076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.142758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eea83f-4301-41ec-87cd-a7d04ea76fea None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.175037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.175909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.178329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.178632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] PATH_INFO: `/v3/users/340cc0d3ab1245fda8b804350220ffcf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.193025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] RBAC: Authorizing `identity:get_user(user_id=340cc0d3ab1245fda8b804350220ffcf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.194863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.196596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 514/1049] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/users/340cc0d3ab1245fda8b804350220ffcf => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.197366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.230145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a88c5-8b35-4c13-80dd-f3ab631dd14c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.263078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.263870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.264154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.264429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.270886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.272328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:35.285681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:35.286744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 536/1050] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:35.287628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.293442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea2d2e-fb93-4ed2-a1e6-b52b5e988910 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.326628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.327411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.327700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.327983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.328634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.330071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:35.341329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:35.342344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:35.343174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 515/1051] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:35.343941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.383005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f403a-bfa0-4360-b825-098192c95d08 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.414430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.415065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.415344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.415619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.441743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53ecf2-92fd-4c09-95ba-55cf044635f3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.474320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.474969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.475253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.475532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.476310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.476623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.478085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.480595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.482101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.489611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 516/1052] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.490408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.575563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 537/1053] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:35.576405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.584893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90207f44-0be1-4838-a5b4-66aa5a6bf3cc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.617280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.617975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.618265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.618550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.619251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.619564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.620942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.631098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 517/1054] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.631098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.673553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283545fd-f255-43a0-9503-3b1886c36568 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.705294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.705969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.706257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.706537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.707362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] RBAC: Adding query filter params (role.id=9813d1b498b648e3ace70270ac62bec6, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.707675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.709132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.714407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 538/1055] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9813d1b498b648e3ace70270ac62bec6 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.715221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.720424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f24380-e282-4002-9438-d5e3f9303b7a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.756761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.757695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.757974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.758253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.759514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.760964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.763110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 518/1056] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.769137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.821234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c7610-8f53-4828-b3f3-83af4283bdff None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.855907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.856621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.856905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.857181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.857937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] RBAC: Adding query filter params (type=image) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.858244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.859630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.865386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 539/1057] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.871231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:35.876017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09555-cce7-4308-a43e-53c86c8fcd65 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:35.912216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:35.912880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:35.913166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:35.913444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:35.914304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=918b4dece61c4e89a1417b9e8130359e, user.id=340cc0d3ab1245fda8b804350220ffcf) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:35.914624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:35.916082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c6712-c645-44fc-851e-2e4bf3ccf909 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:35.929791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 519/1058] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:35 2022] GET /identity/v3/role_assignments?user.id=340cc0d3ab1245fda8b804350220ffcf&scope.project.id=918b4dece61c4e89a1417b9e8130359e&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:35.975204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4a3d-f61d-410a-ad24-03df3a63cb42 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:36.013137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:36.013848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:36.014135 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:36.014417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:36.015172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:36.016586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0be9c-faa5-470f-86c2-d4c4b3e0afec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:36.038585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 540/1059] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:45:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:37.949371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6960ec-a1ef-4028-957e-36dec7c97e45 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:37.949987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6960ec-a1ef-4028-957e-36dec7c97e45 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:37.949987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6960ec-a1ef-4028-957e-36dec7c97e45 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:37.951580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 520/1060] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:37.958154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d740-82aa-44ce-8656-da9b6b2f7c54 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:37.958661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d740-82aa-44ce-8656-da9b6b2f7c54 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:37.958736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d740-82aa-44ce-8656-da9b6b2f7c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:37.975694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3e89d740-82aa-44ce-8656-da9b6b2f7c54 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:37.976888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3e89d740-82aa-44ce-8656-da9b6b2f7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:38.053527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 541/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:38.072850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6960ec-a1ef-4028-957e-36dec7c97e45 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.123545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee067f-fad7-4a38-bf62-5c394c3ac0f9 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.123837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee067f-fad7-4a38-bf62-5c394c3ac0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.124121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee067f-fad7-4a38-bf62-5c394c3ac0f9 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.125595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 542/1062] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:38.131538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.131831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.132128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.148580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:38.149784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:38.188399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6960ec-a1ef-4028-957e-36dec7c97e45 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.221738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 543/1063] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:38.230364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.231254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.231606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.231951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.240755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.243308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:38.251464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:38.252602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:38.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:38.257878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 521/1064] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:38.258911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.336822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519181-45a6-4f4c-838f-2a6b125abbdb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.353034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37205734-a83b-49e4-a455-625bbbb34d55 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.368988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.369807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.370091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.370368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.380893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:38.385165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.385847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.386130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.386405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.387393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:38.387697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-778e1a31-10c4-437f-b30f-256bdc5d624e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:38.388675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:38.389743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:38.390569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:38.391199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38583b-2c03-4953-9700-21ad117b5cca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.391278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 544/1065] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:38.391451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc6ad-7aa4-435c-bfcb-4f65d9b282ab None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.391672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc6ad-7aa4-435c-bfcb-4f65d9b282ab None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.391949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc6ad-7aa4-435c-bfcb-4f65d9b282ab None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.393617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 545/1066] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:38.396373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffc6ad-7aa4-435c-bfcb-4f65d9b282ab None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.400559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 522/1067] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:38.401710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.402003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.402282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.418116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:38.419313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:38.482974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 523/1068] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:38.483807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.492798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffc6ad-7aa4-435c-bfcb-4f65d9b282ab None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.529549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.530219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.530563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.530859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.531638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:38.532055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.534506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.544301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 546/1069] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:38.545121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.595347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299423d3-872c-4b14-85c5-a23218a15faf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.628338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.629184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.629487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.629779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.639057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac396-9e17-41d4-9265-eb6316a35c5c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.639510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.640947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:38.657697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:38.659112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:38.659980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:38.659980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:38.659980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:38.659980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:38.659980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 524/1070] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:38.660534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.671654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006845f-1c65-4805-9091-898185be488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.672293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006845f-1c65-4805-9091-898185be488a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.672574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006845f-1c65-4805-9091-898185be488a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.672846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006845f-1c65-4805-9091-898185be488a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.736113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006845f-1c65-4805-9091-898185be488a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.738167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006845f-1c65-4805-9091-898185be488a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.758376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340edb89-d8c5-4a2a-9cfd-b763d379d118 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.790862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.791719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.792002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.792274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] PATH_INFO: `/v3/users/340cc0d3ab1245fda8b804350220ffcf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.793450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] RBAC: Authorizing `identity:get_user(user_id=340cc0d3ab1245fda8b804350220ffcf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.794890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.796504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 525/1071] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/users/340cc0d3ab1245fda8b804350220ffcf => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:38.797254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.839895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 547/1072] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:38.839895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006845f-1c65-4805-9091-898185be488a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.896210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ce27-f0ec-4c9d-8da1-74dada9d3e2f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.928915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.929601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.929888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.930169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.930881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:38.931190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.931545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006845f-1c65-4805-9091-898185be488a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:38.932550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.943868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 526/1073] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:38.944650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:38.965567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:38.966418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:38.966734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:38.967014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:38.968193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:38.969651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:38.972042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 548/1074] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:38.972675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.041108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e26f2-5e08-49d4-ba64-878b27a6ea49 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.069026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ae4-bed9-4a90-9dc7-2b1227124ba6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.072283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.073068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.073354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.073674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.084389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.085852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.102609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:39.102824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:39.103787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:39.104673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:39.104673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:39.104673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:39.104673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:39.104900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.104900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.104900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.105085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 527/1075] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:39.105085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.112590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.114072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:39.128105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:39.129208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 549/1076] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:45:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:39.130187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.204206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f082a-db70-4a9b-a876-abf4436415b1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.225324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a096c2-2aec-4b68-843f-34607fc7c38a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.236654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.237652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.237933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.238207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e/users/340cc0d3ab1245fda8b804350220ffcf/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.240309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=918b4dece61c4e89a1417b9e8130359e, user_id=340cc0d3ab1245fda8b804350220ffcf, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.242055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.256281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 528/1077] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:39 2022] PUT /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e/users/340cc0d3ab1245fda8b804350220ffcf/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:39.257079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.270260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.270980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.271244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.271523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.272269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:39.272577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.274057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.297592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 550/1078] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:39.370223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56ffd-fc8c-4139-8546-34906c2c1cfc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.408816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.409547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.409835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.410112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.410988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:39.411301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.412802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.437343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 529/1079] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:39.438637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.542319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e874-a506-44a0-b5fc-0aec3b4bc715 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.575943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.576666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.576949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.577222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.588871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.590340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:39.607661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:39.608768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:39.610143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:39.610143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:39.610143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:39.610143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:39.610143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 551/1080] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:39.615079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.712461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbae9-770c-4ccd-8821-5f739e0eeb80 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.744663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.745323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.745642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.745922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.746639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:39.746949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.748304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.759607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 530/1081] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:39.765027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:39.860852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d35c-aef1-45c8-9d7e-5b04716190de None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:39.892242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:39.893617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:39.893903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:39.894179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:39.900569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:39.902030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:39.915618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:39.916610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:39.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 552/1082] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:39.922618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:40.020657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4161e-8e10-4549-8b7c-73bfb820526b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:40.051923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:40.052565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:40.052840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:40.053116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:40.053929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:40.054238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:40.055650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ca7d-14f6-4685-a849-2d2203251ba0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:40.067893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 531/1083] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:40.073725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:40.167676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb639-7c7d-44ca-9cf0-cf37fab99804 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:40.199707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:40.200587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:40.200867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:40.201137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/9813d1b498b648e3ace70270ac62bec6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:40.203340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=103951448cfc47bbb702f2117cc5b362, role_id=9813d1b498b648e3ace70270ac62bec6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:40.204755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8ca15-ace1-4526-bc29-056679b09413 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:40.218815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 553/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:40 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/103951448cfc47bbb702f2117cc5b362/roles/9813d1b498b648e3ace70270ac62bec6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:41.521218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46bf8-e66f-4277-bd1c-bf5a7a3dd9dc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:41.521764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46bf8-e66f-4277-bd1c-bf5a7a3dd9dc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:41.521855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46bf8-e66f-4277-bd1c-bf5a7a3dd9dc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:41.523175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 532/1085] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:41.528527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:41.528942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:41.529091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:41.545977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:41.547152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:41.610658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 554/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:41.634676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a46bf8-e66f-4277-bd1c-bf5a7a3dd9dc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:41.729287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a46bf8-e66f-4277-bd1c-bf5a7a3dd9dc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:41.761100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:41.762165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:41.762446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:41.762720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:41.772362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:41.779883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:41.781042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:41.781953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 533/1087] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:41.787628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:41.880981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732164-21ea-40ce-850e-5878b642a5a5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:41.913259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:41.913957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:41.914248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:41.914530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:41.915276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:41.915589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:41.916959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:41.925951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 555/1088] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:41.931538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.027622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0d25-5f9e-4472-bc27-58095c06daa2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.059828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.060695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.060979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.061250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] PATH_INFO: `/v3/users/340cc0d3ab1245fda8b804350220ffcf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.062456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] RBAC: Authorizing `identity:get_user(user_id=340cc0d3ab1245fda8b804350220ffcf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.063871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.066093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 534/1089] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:41 2022] GET /identity/v3/users/340cc0d3ab1245fda8b804350220ffcf => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:42.071663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.165989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab38c-a2cf-46f2-add4-105bc527c236 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.198732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.199387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.199668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.199941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.269011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.270489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d119190-5919-4bb1-8efc-9ee307a3e524 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.362024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 556/1090] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 05:45:42.367673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.393800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1856e-fad2-4c2e-8718-f964f91441ff None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.394088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1856e-fad2-4c2e-8718-f964f91441ff None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.394366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1856e-fad2-4c2e-8718-f964f91441ff None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.395791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 557/1091] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:45:42.400763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.401051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.401330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.417265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:42.418470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:42.463024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ee43-b667-4c1b-89a9-067bcd8063d6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.481057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 558/1092] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:42.495569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.496428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.496715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.496997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.498198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.499634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.506294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 535/1093] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:45:42.506451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.507204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.597580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d461ea-0389-4c85-a419-dd81be233dea None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.600691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7139-5c35-447f-8c9f-b57988ce3bd2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.631138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.631868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.632151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.632421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.634892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.635541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.635830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.636112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.637203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=918b4dece61c4e89a1417b9e8130359e, user.id=340cc0d3ab1245fda8b804350220ffcf) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:42.637544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.638975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.642267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:45:42.645598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 536/1094] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/role_assignments?user.id=340cc0d3ab1245fda8b804350220ffcf&scope.project.id=918b4dece61c4e89a1417b9e8130359e&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:45:42.651043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:42.652229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:42.653197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 559/1095] 10.222.0.44 () {56 vars in 1120 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:42.659191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.762082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777636-6060-4fa8-92d8-aea184169af5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.796195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.796866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.797150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.797422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.798197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:42.798503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.800434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.813647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 537/1096] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:42.815444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:42.912714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85df15-7516-4309-b550-63459d22a9c0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:42.945102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:42.945927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:42.946215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:42.946495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:42.956703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:42.958180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:42.975074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:42.976000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:42.976882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:42.976882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:42.976882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:42.976882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:42.976882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 560/1097] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:42.981993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:43.077433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b291c9-5c1b-4b33-ad93-618a1a6273e3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:43.109140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:43.109818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:43.110104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:43.110382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:43.111638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:43.111965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:43.113357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:43.124697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 538/1098] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:43.130379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:43.232517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe634df-d123-4f44-9db7-0a6f9ba1688f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:43.265717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:43.266498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:43.266783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:43.267059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:43.276220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:43.277719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:45:43.292647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:43.293670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:45:43.300247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 561/1099] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 11 05:45:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:45:43.300977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:43.394592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daadafe-6df0-45b6-a0d2-31b1703c2020 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:43.428715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:43.429378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:43.429689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:43.429967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:43.430798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:43.431104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:43.432522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:43.449438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 539/1100] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 11 05:45:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:43.456276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:43.554177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bda1a-8aa5-432b-a43f-2f9be2d7d2ee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:43.586559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:43.587199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:43.587484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:43.587763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:43.652476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:43.653956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:43.746036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 562/1101] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:43.751601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:43.849719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ea11-244c-43cb-853c-58f3b6b926bd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:43.881745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:43.882551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:43.882813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:43.883086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:43.893490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:43.894931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:45:43.911608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:43.912509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:43.913417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:45:43.913417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:45:43.913417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:45:43.913417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:43.913417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 540/1102] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:43.918337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:44.011243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15263e-162c-42bd-9bd6-e0cbfb995d24 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:44.043347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:44.043996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.044277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.044553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.045260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:44.045596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:44.047056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:44.057753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 563/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:44.063187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:44.158264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff0e9-9b86-48f2-8a5a-e533e97cc145 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:44.190600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:44.191389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.191674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.191957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.198443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:44.199883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:45:44.213708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:45:44.214608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:45:44.215506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 541/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:45:44.221093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:44.315023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9895-f21c-4667-a92c-22eaed043fa0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:44.346934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:44.347611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.347893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.348164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.349257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:44.349605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:44.351027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98e6b-8375-4594-94bc-ae979e053665 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:44.362649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 564/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:44.368569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:44.464037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa8a10-3d8b-4e00-952e-6f52ae305f3d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:44.496198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:44.496846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.497132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.497409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.498266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] RBAC: Adding query filter params (role.id=9813d1b498b648e3ace70270ac62bec6, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=103951448cfc47bbb702f2117cc5b362) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:44.498580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:44.500005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb572f-955a-44d3-a16a-738cea4f3c8f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:44.506132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 542/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:44 2022] GET /identity/v3/role_assignments?user.id=103951448cfc47bbb702f2117cc5b362&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9813d1b498b648e3ace70270ac62bec6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:44.923028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c9c8-829e-4ce3-8332-ae27e595f03f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.924030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c9c8-829e-4ce3-8332-ae27e595f03f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.924140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c9c8-829e-4ce3-8332-ae27e595f03f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.925432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 565/1107] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:44.931012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:44.931434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:44.931566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:44.948182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:44.949357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:45.014448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 543/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:45.039400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c9c8-829e-4ce3-8332-ae27e595f03f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:45.138971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c9c8-829e-4ce3-8332-ae27e595f03f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:45.174752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:45.175541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:45.175833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:45.176116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:45.177371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:45.178915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c058b3-33f7-49ad-85bb-7a28da7299de None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:45.180569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 566/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:45.186673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:45.287708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba829-7da9-40cd-b006-e945f1485bd7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:45.324589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:45.325277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:45.325589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:45.325873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:45.326608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:45.328041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b900f1-4006-4d32-896a-489595a783ec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:45.349227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 544/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:45:45 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:47.681414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321a4d-267f-4a7d-b4a1-96177a194042 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:47.682031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321a4d-267f-4a7d-b4a1-96177a194042 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:47.682031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321a4d-267f-4a7d-b4a1-96177a194042 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:47.683336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 567/1111] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:47.688558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:47.689526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:47.689699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:47.706587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:47.707779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:47.770381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 545/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:47.793814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7321a4d-267f-4a7d-b4a1-96177a194042 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:47.887684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7321a4d-267f-4a7d-b4a1-96177a194042 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:47.918607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:47.919428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:47.919705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:47.919974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] PATH_INFO: `/v3/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:47.921412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] RBAC: Authorizing `identity:get_role(role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:47.922790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:47.924655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 568/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:47 2022] GET /identity/v3/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:47.930286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:48.023218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958550d-99b1-4c89-978e-6b26c01075ba None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:48.054905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:48.055750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:48.056036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:48.056316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] PATH_INFO: `/v3/users/ea3d4253bfc949d084057e0e86da3895` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:48.069163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d4253bfc949d084057e0e86da3895)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:48.070636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:48.072262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 546/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:47 2022] GET /identity/v3/users/ea3d4253bfc949d084057e0e86da3895 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:48.077793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:48.169924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e251-09dd-4f24-853e-84c95c3c75ed None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:48.201715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:48.202355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:48.202641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:48.202920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:48.266107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:48.268253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:48.358438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 569/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:48.364246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:48.456899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973eb73-62fd-44d9-973f-10bf18c547e6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:48.488175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:48.489010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:48.489299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:48.489606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:48.490772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:48.492187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d07594-2894-4ab1-a742-2b7e32468d7f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:48.493891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 547/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:48 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:48.500001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:48.593577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7675-8a25-4a8a-b31d-949dc0b45ded None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:48.625580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:48.626163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:48.626518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:48.627389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:48.628307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=918b4dece61c4e89a1417b9e8130359e, user.id=ea3d4253bfc949d084057e0e86da3895) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:48.628626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:48.630087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7b18-3320-497c-8da1-66ac7a13cb0e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:48.635251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 570/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:48 2022] GET /identity/v3/role_assignments?user.id=ea3d4253bfc949d084057e0e86da3895&scope.project.id=918b4dece61c4e89a1417b9e8130359e&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:50.789537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80cbd-c0be-4524-9535-ac65064eca17 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:50.790091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80cbd-c0be-4524-9535-ac65064eca17 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:50.790091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80cbd-c0be-4524-9535-ac65064eca17 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:50.791456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 548/1118] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:50.796523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:50.796958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:50.797057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:50.813800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:50.814956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:50.877900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 571/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:50.900934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80cbd-c0be-4524-9535-ac65064eca17 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:50.996875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80cbd-c0be-4524-9535-ac65064eca17 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:51.029316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:51.030178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:51.030461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:51.030735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] PATH_INFO: `/v3/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:51.032201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] RBAC: Authorizing `identity:get_role(role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:51.034166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:51.035517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 549/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:50 2022] GET /identity/v3/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:51.041429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:51.133759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b337f-de41-4328-990f-7aec8ac10b89 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:51.165583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:51.166432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:51.166711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:51.166986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] PATH_INFO: `/v3/users/ea3d4253bfc949d084057e0e86da3895` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:51.168166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d4253bfc949d084057e0e86da3895)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:51.169623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:51.171205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 572/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:51 2022] GET /identity/v3/users/ea3d4253bfc949d084057e0e86da3895 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:51.177813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:51.270972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc0ff-9061-4782-bd51-7cebf3515a0e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:51.303138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:51.303922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:51.304208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:51.304484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:51.305683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:51.307163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8db72-974d-45ce-940b-f1df6b4ae9be None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:51.308819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 550/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:51 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:51.314845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:51.408388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e2b1-6055-41aa-97a4-f50305e33aaf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:51.440130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:51.440985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:51.441265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:51.441563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e/users/ea3d4253bfc949d084057e0e86da3895/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:51.443702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] RBAC: Authorizing `identity:create_grant(project_id=918b4dece61c4e89a1417b9e8130359e, user_id=ea3d4253bfc949d084057e0e86da3895, role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:51.445113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffae72-b4e6-4165-a87a-25dbafd8a020 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:51.457934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 573/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:45:51 2022] PUT /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e/users/ea3d4253bfc949d084057e0e86da3895/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:45:53.614436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1a2a-b8b4-46f1-b695-e9a9c62d6fd4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:53.614989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1a2a-b8b4-46f1-b695-e9a9c62d6fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:53.614989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1a2a-b8b4-46f1-b695-e9a9c62d6fd4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:53.616353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 551/1124] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:53.621464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:53.621881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:53.622037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:53.638357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:53.639526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:53.701669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 574/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:45:53.725224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d1a2a-b8b4-46f1-b695-e9a9c62d6fd4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:53.820366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d1a2a-b8b4-46f1-b695-e9a9c62d6fd4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:53.852087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:53.852915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:53.853194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:53.853495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] PATH_INFO: `/v3/roles/914c9f10127c4ed1a0642000fbd15d37` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:53.854935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] RBAC: Authorizing `identity:get_role(role_id=914c9f10127c4ed1a0642000fbd15d37)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:53.856293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:53.857654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 552/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:53 2022] GET /identity/v3/roles/914c9f10127c4ed1a0642000fbd15d37 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:53.863303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:53.955441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558fb-5c2f-45d8-af5c-3f30dd4ed8a9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:53.987120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:53.987968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:53.988254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:53.988523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] PATH_INFO: `/v3/users/ea3d4253bfc949d084057e0e86da3895` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:53.989711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d4253bfc949d084057e0e86da3895)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:53.991125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:53.992706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 575/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:45:53 2022] GET /identity/v3/users/ea3d4253bfc949d084057e0e86da3895 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:53.998132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:54.090187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5144-21d1-474f-9f7d-d044df88251f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:54.121588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:54.122212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:54.122493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:54.122765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:54.185747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:54.187186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:54.277898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 553/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:45:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:45:54.284252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:54.376622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701386dd-1d52-46f6-afe1-40efde1d8f0a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:54.408704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754183-123c-4346-96c2-89f268051030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:54.409573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754183-123c-4346-96c2-89f268051030 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:54.409858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754183-123c-4346-96c2-89f268051030 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:54.410135 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754183-123c-4346-96c2-89f268051030 None admin] PATH_INFO: `/v3/projects/918b4dece61c4e89a1417b9e8130359e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:54.411304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754183-123c-4346-96c2-89f268051030 None admin] RBAC: Authorizing `identity:get_project(project_id=918b4dece61c4e89a1417b9e8130359e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:54.412728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754183-123c-4346-96c2-89f268051030 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:54.414418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 576/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:45:54 2022] GET /identity/v3/projects/918b4dece61c4e89a1417b9e8130359e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:54.420279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:54.511553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2b41-aac5-4c6d-9068-cf96a9387c84 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:54.544026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:54.544601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:54.544883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:54.545156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:54.545998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] RBAC: Adding query filter params (role.id=914c9f10127c4ed1a0642000fbd15d37, scope.project.id=918b4dece61c4e89a1417b9e8130359e, user.id=ea3d4253bfc949d084057e0e86da3895) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:45:54.546310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:54.547713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b447-cfb2-4c29-ae72-62032b6507a9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:54.553962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 554/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:45:54 2022] GET /identity/v3/role_assignments?user.id=ea3d4253bfc949d084057e0e86da3895&scope.project.id=918b4dece61c4e89a1417b9e8130359e&role.id=914c9f10127c4ed1a0642000fbd15d37 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:56.747507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59324-e6be-4865-b967-8d471ae344a4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:56.748071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59324-e6be-4865-b967-8d471ae344a4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:56.748071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59324-e6be-4865-b967-8d471ae344a4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:56.749408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 577/1131] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:56.754610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:56.755003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:56.755179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:56.771708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:56.772892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:56.836641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 555/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:56.859669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59324-e6be-4865-b967-8d471ae344a4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:56.953529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59324-e6be-4865-b967-8d471ae344a4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:56.985191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:56.986085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:56.986370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:56.986646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:56.987796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:56.989211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242dcc8-2664-4ce2-9785-5c8da88e471f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:56.990813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 578/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:56.996454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:57.089426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9dea-4a91-4519-a89c-23465fc9e90c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:57.121222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:57.121896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:57.122186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:57.122466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:57.123167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:57.124587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebfdd4-e890-444c-84bc-b4a5371e2e69 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:57.148886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 556/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:45:56 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:45:59.352347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002a0-84b1-4995-b003-3403e12cdcae None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:59.352882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002a0-84b1-4995-b003-3403e12cdcae None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:59.352882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002a0-84b1-4995-b003-3403e12cdcae None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:59.354273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 579/1135] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:45:59.359371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:59.359810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:59.359921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:59.377274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:45:59.378599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:45:59.442744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 557/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:45:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:45:59.467002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a002a0-84b1-4995-b003-3403e12cdcae None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:59.578692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a002a0-84b1-4995-b003-3403e12cdcae None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:59.610032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:59.611488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:59.611864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:59.612142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:59.613311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:59.614779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb6319-3958-47b5-b214-228b7b4b8cec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:59.616375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 580/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:45:59.622097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:45:59.713988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d42ba6-a8f0-4796-b1f6-4b413d6408b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:45:59.745813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:45:59.746468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:45:59.746750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:45:59.747028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:45:59.747733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:45:59.749151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71213d-47f2-497d-8a75-9937406dad2e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:45:59.767846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 558/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:45:59 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:46:02.005082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fec8-8f5e-4aad-bdf7-75c647c6c032 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.005674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fec8-8f5e-4aad-bdf7-75c647c6c032 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.005674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fec8-8f5e-4aad-bdf7-75c647c6c032 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.007025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 581/1139] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:02.012495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.012898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.013049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.030020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:02.031188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:02.093684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 559/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:02.116721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fec8-8f5e-4aad-bdf7-75c647c6c032 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:02.213431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fec8-8f5e-4aad-bdf7-75c647c6c032 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:02.245128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:02.245930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.246216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.246493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.256682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:02.264665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:02.265854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:02.266814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 582/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:02.272362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:02.368402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f31449-878f-47f2-bc9a-e106ffc35845 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:02.401217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:02.401899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.402185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.402459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.403194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:02.403505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:02.404859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:02.412643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 560/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:02.418239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:02.515475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0846f-cbdd-43f5-9542-385a20dcbce4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:02.549668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:02.550529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.550814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.551092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] PATH_INFO: `/v3/users/794b89f0364e49d3809027a71908824a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.564151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] RBAC: Authorizing `identity:get_user(user_id=794b89f0364e49d3809027a71908824a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:02.565633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:02.567270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 583/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/users/794b89f0364e49d3809027a71908824a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:02.572928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:02.667668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc3806-10e4-432a-aff5-f0155dc2abfc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:02.698601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:02.699227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.699510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.699784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.761942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:02.763842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:02.855705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 561/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:46:02.861455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:02.953747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a9db-1a8e-4eb5-affe-807ac90fe288 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:02.985751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:02.986568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:02.986845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:02.987114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] PATH_INFO: `/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:02.988264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] RBAC: Authorizing `identity:get_project(project_id=ee38a139cc314ac2a5105e3c3630d9f9)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:02.989698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ec3cf-7423-41f9-bebd-3efb84e3287c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:02.991348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 584/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:02.997277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:03.088738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785082b-95e3-41e4-8203-a49982637587 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:03.120229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:03.120806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:03.121087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:03.121359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:03.122204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=ee38a139cc314ac2a5105e3c3630d9f9, user.id=794b89f0364e49d3809027a71908824a) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:03.122514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:03.123917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b66a5-2f71-4a5d-941e-8a5b0b345a13 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:03.129256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 562/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:46:02 2022] GET /identity/v3/role_assignments?user.id=794b89f0364e49d3809027a71908824a&scope.project.id=ee38a139cc314ac2a5105e3c3630d9f9&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:05.296651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf307-fd95-4bb0-ba55-15c92e382d75 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.297184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf307-fd95-4bb0-ba55-15c92e382d75 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.297184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf307-fd95-4bb0-ba55-15c92e382d75 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.299353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 585/1147] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:05.304451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.304835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.305022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.322152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:05.323337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:05.386483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 563/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:05.409045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf307-fd95-4bb0-ba55-15c92e382d75 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:05.503738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf307-fd95-4bb0-ba55-15c92e382d75 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:05.536334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:05.537108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.537388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.537826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.547489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:05.555585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:05.556708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:05.557657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 586/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:05.562833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:05.655120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574829-bee3-4c03-864d-16a7b37c654e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:05.687725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:05.688583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.688878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.689156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.689924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:05.690236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:05.691589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:05.699203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 564/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:05.705126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:05.799559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b484-08c2-45af-9af3-261fbd195e4a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:05.830478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:05.831321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.831600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.831873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] PATH_INFO: `/v3/users/794b89f0364e49d3809027a71908824a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.833026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] RBAC: Authorizing `identity:get_user(user_id=794b89f0364e49d3809027a71908824a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:05.834588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:05.836163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 587/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:05 2022] GET /identity/v3/users/794b89f0364e49d3809027a71908824a => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:05.841831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:05.935702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5146e-6132-46ce-886f-9ff89a0c4d60 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:05.966919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:05.967755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:05.968035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:05.968306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] PATH_INFO: `/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:05.969463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee38a139cc314ac2a5105e3c3630d9f9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:05.971571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbe9d-94e1-4124-b1c2-a1b6a15d08f7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:05.973222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 565/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:05 2022] GET /identity/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:05.978963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:06.073185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f6f8-f51c-4d6a-bf2d-f784fd47e662 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:06.105090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:06.105991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:06.106274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:06.106546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] PATH_INFO: `/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9/users/794b89f0364e49d3809027a71908824a/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:06.108480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee38a139cc314ac2a5105e3c3630d9f9, user_id=794b89f0364e49d3809027a71908824a, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:06.109940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f653a-b17c-49d5-952a-01d642e22211 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:06.122725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 588/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:46:05 2022] PUT /identity/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9/users/794b89f0364e49d3809027a71908824a/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:46:08.303753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2645-a283-48ec-8074-34d4a3934887 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.304259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2645-a283-48ec-8074-34d4a3934887 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.304350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2645-a283-48ec-8074-34d4a3934887 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:08.305700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 566/1154] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:08.310960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.311365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.311573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:08.328246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:08.329420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:08.391291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 589/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:08.414359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2645-a283-48ec-8074-34d4a3934887 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:08.511138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2645-a283-48ec-8074-34d4a3934887 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:08.543941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:08.544719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.545004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.545277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:08.555507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:08.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:08.564198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:46:08.565401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 567/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:08.570352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:08.662163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff5d7-6c50-43f2-9caf-70ce9ebfae3b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:08.693791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:08.694443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.694725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.694999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:08.695735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:08.696044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:08.697402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:08.704975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 590/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:08.710554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:08.804744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b2464-bd58-418b-b9f9-55604f29d010 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:08.836598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:08.837446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.837760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.838037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] PATH_INFO: `/v3/users/794b89f0364e49d3809027a71908824a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:08.839224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] RBAC: Authorizing `identity:get_user(user_id=794b89f0364e49d3809027a71908824a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:08.840633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:08.842247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 568/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:08 2022] GET /identity/v3/users/794b89f0364e49d3809027a71908824a => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:08.848387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:08.940205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c338d-30cb-44ba-a385-3fe9e42a93df None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:08.971541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:08.972168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:08.972450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:08.972723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:09.034921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:09.036344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:09.126346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 591/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:46:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:46:09.132013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:09.227626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b124f2-027c-4b92-9d2a-a27f252acb40 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:09.259420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:09.260262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:09.260543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:09.260818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] PATH_INFO: `/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:09.262263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] RBAC: Authorizing `identity:get_project(project_id=ee38a139cc314ac2a5105e3c3630d9f9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:09.263676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b73c56-6197-4fdc-824d-e3d1a232fa12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:09.265341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 569/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:09 2022] GET /identity/v3/projects/ee38a139cc314ac2a5105e3c3630d9f9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:09.271873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:09.364206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77122ed0-c893-4f3a-8a8e-56e3bbf3ead7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:09.396618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:09.397198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:09.397500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:09.397780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:09.398589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=ee38a139cc314ac2a5105e3c3630d9f9, user.id=794b89f0364e49d3809027a71908824a) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:09.398897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:09.400325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce24a0-4a17-417c-84e1-e810237aa56d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:09.405871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 592/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:46:09 2022] GET /identity/v3/role_assignments?user.id=794b89f0364e49d3809027a71908824a&scope.project.id=ee38a139cc314ac2a5105e3c3630d9f9&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:11.633093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5cdb-f990-4bea-9004-ce81a365f636 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:11.633678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5cdb-f990-4bea-9004-ce81a365f636 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:11.633678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5cdb-f990-4bea-9004-ce81a365f636 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:11.635029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 570/1162] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:11.640561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:11.640971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:11.641139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:11.657843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:11.659007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:11.720929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 593/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:11.743599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc5cdb-f990-4bea-9004-ce81a365f636 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:11.838378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc5cdb-f990-4bea-9004-ce81a365f636 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:11.870146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:11.870783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:11.871070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:11.871350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:11.934339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:11.935715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:12.027031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 571/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:46:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:46:12.033601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:12.125323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db3e6-f7df-4d3f-a6a6-71ad82a27472 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:12.157843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:12.158624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:12.158908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:12.159186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:12.165512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:12.166934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b33d2b94-e763-44da-9de8-68bf985e07bb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:12.180669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:12.181746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:12.182643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 594/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:46:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:12.187858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:12.280186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4dae-972b-457f-997a-f6f59569a29e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:12.310910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:12.311545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:12.311827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:12.312107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:12.312807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:12.313653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:12.315018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e569ad-7e0e-40c4-a631-633242a2a6d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:12.321785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 572/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Wed May 11 05:46:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:14.486200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140bde-9d8c-483a-a8fc-b10ac7010340 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:14.486725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140bde-9d8c-483a-a8fc-b10ac7010340 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:14.486818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140bde-9d8c-483a-a8fc-b10ac7010340 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:14.488123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 595/1167] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:14.493358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721aab-c6d8-48da-9f59-f58590eb3c90 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:14.493772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721aab-c6d8-48da-9f59-f58590eb3c90 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:14.493963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721aab-c6d8-48da-9f59-f58590eb3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:14.510925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1b721aab-c6d8-48da-9f59-f58590eb3c90 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:14.512395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b721aab-c6d8-48da-9f59-f58590eb3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:14.575662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 573/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:14.598106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140bde-9d8c-483a-a8fc-b10ac7010340 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:14.695031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140bde-9d8c-483a-a8fc-b10ac7010340 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:14.726335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:14.726977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:14.727262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:14.727540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:14.728273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:14.729670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d66217-50f5-44d6-8f0b-f50841ea3c48 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:14.744833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 596/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Wed May 11 05:46:14 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:46:16.960942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad56c-e752-46b8-8329-43ff7c83aa8a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:16.961613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad56c-e752-46b8-8329-43ff7c83aa8a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:16.961613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad56c-e752-46b8-8329-43ff7c83aa8a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:16.962878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 574/1170] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:16.967961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:16.968353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:16.968516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:16.985991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:16.987145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:17.048178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 597/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:17.070864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ad56c-e752-46b8-8329-43ff7c83aa8a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:17.166236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ad56c-e752-46b8-8329-43ff7c83aa8a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:17.197798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:17.198646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:17.198932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:17.199208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] PATH_INFO: `/v3/domains/369bbe52ae59408690854f8410f53064` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:17.209617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=369bbe52ae59408690854f8410f53064)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:17.211098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206d33d-2380-4583-a77e-95edf1b4cf4a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:17.212673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 575/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Wed May 11 05:46:17 2022] GET /identity/v3/domains/369bbe52ae59408690854f8410f53064 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:17.218392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:17.311846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e63bbb-1b58-4f35-b41d-bf0785048296 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:17.343596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:17.345000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:17.345531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:17.345825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:17.346529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:17.347967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2e7d-d066-4ffd-9e8e-0a6ea2fb0637 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:17.371576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 598/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:46:17 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:46:19.600858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d4b9-a6ff-4fd4-b673-24bd7e91b06f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:19.601415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d4b9-a6ff-4fd4-b673-24bd7e91b06f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:19.601415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d4b9-a6ff-4fd4-b673-24bd7e91b06f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:19.602820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 576/1174] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:19.608058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:19.608455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:19.608624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:19.626947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:19.628135 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:19.690650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 599/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:19.715444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d4b9-a6ff-4fd4-b673-24bd7e91b06f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:19.811692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d4b9-a6ff-4fd4-b673-24bd7e91b06f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:19.842908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:19.843746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:19.844638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:19.845025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] PATH_INFO: `/v3/domains/369bbe52ae59408690854f8410f53064` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:19.846107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=369bbe52ae59408690854f8410f53064)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:19.847522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9961de-948e-445f-baf5-a06aa8aed4c5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:19.849105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 577/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Wed May 11 05:46:19 2022] GET /identity/v3/domains/369bbe52ae59408690854f8410f53064 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:19.854731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:19.947224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c163-25f1-4e1d-b8a7-987c60b7cd2e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:19.978933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:19.979580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:19.979858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:19.980129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:19.980821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:19.982285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f240b-3f8c-4af5-8840-57be0a8a57df None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:20.000837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 600/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:46:19 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:46:22.261064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5997-960e-44d7-8e33-49ba966dc7a4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.261861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5997-960e-44d7-8e33-49ba966dc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.261968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5997-960e-44d7-8e33-49ba966dc7a4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:22.263263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 578/1178] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:22.269038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.269571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.269678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:22.285756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:22.286920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:22.348568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 601/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:22.372716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a5997-960e-44d7-8e33-49ba966dc7a4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:22.472144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a5997-960e-44d7-8e33-49ba966dc7a4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:22.504773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:22.505573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.505861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.506141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:22.517090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:22.524690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:22.525887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:46:22.526973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 579/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:22.532670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:22.625850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc2956-0598-4fc4-849f-595cb0404fd4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:22.657403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:22.658081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.658364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.658639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:22.659371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:22.659680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:22.661034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:22.668619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 602/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:22.674761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:22.768677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb323c8-3524-4b8b-9b4a-acf2ddadb426 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:22.799770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:22.800616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.800902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.801182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] PATH_INFO: `/v3/users/6cfa57c3422047d19917e66e6af7c4ca` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:22.813889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] RBAC: Authorizing `identity:get_user(user_id=6cfa57c3422047d19917e66e6af7c4ca)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:22.815321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:22.816929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 580/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:22 2022] GET /identity/v3/users/6cfa57c3422047d19917e66e6af7c4ca => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:22.822470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:22.916024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf8387-dc12-46a3-a29b-0aca2bc27308 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:22.947259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:22.947882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:22.948165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:22.948441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:23.009722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:23.011171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:23.101442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 603/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:46:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:46:23.107346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:23.200804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd640-2fff-4f73-a875-783492b0911c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:23.233245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:23.234119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:23.234411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:23.234978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] PATH_INFO: `/v3/projects/18b13f67b3e741ddab14265b3de64968` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:23.235938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] RBAC: Authorizing `identity:get_project(project_id=18b13f67b3e741ddab14265b3de64968)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:23.237351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2ab0-778c-4a50-b609-85b63fd6ac14 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:23.239051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 581/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:23 2022] GET /identity/v3/projects/18b13f67b3e741ddab14265b3de64968 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:23.245024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:23.336860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926c935-d70d-4bea-99cb-1403a8daff25 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:23.368695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:23.369274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:23.369617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:23.369895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:23.370713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=18b13f67b3e741ddab14265b3de64968, user.id=6cfa57c3422047d19917e66e6af7c4ca) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:23.371026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:23.372445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d3b4-9313-4926-967b-24dc4ddec4d1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:23.377644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 604/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:46:23 2022] GET /identity/v3/role_assignments?user.id=6cfa57c3422047d19917e66e6af7c4ca&scope.project.id=18b13f67b3e741ddab14265b3de64968&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:25.580417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654811aa-3fdc-42fb-b3d1-e388d8e14571 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:25.580969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654811aa-3fdc-42fb-b3d1-e388d8e14571 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:25.580969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654811aa-3fdc-42fb-b3d1-e388d8e14571 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:25.582387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 582/1186] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:25.587585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:25.587964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:25.588156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:25.604922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:25.606138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:25.670395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 605/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:25.693104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654811aa-3fdc-42fb-b3d1-e388d8e14571 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:25.788889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654811aa-3fdc-42fb-b3d1-e388d8e14571 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:25.820391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:25.821163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:25.821445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:25.821753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:25.832169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:25.839654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:25.840735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:46:25.841961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 583/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:25.846871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:25.940399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478128-4690-4e14-a17d-962e1e07ef75 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:25.972232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:25.972885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:25.973171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:25.973452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:25.974221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:25.974532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:25.975897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:25.983609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 606/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:25.989576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:26.084007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae892f-e3d4-4728-9430-94e8844675b3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:26.115213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:26.116063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:26.116349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:26.116627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] PATH_INFO: `/v3/users/6cfa57c3422047d19917e66e6af7c4ca` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:26.117830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] RBAC: Authorizing `identity:get_user(user_id=6cfa57c3422047d19917e66e6af7c4ca)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:26.119244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:26.120837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 584/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:25 2022] GET /identity/v3/users/6cfa57c3422047d19917e66e6af7c4ca => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:26.126740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:26.221851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1e9a-ea60-4860-bde9-4d5ac3e67e0b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:26.252808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:26.253695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:26.253983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:26.254264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] PATH_INFO: `/v3/projects/18b13f67b3e741ddab14265b3de64968` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:26.255435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] RBAC: Authorizing `identity:get_project(project_id=18b13f67b3e741ddab14265b3de64968)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:26.256869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44974f1-2c3f-484c-b748-b8414ca9b260 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:26.258581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 607/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:26 2022] GET /identity/v3/projects/18b13f67b3e741ddab14265b3de64968 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:26.264607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:26.360133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e192ed-c5ba-45cd-938f-fa19cd8ab9ae None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:26.392058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:26.392929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:26.393212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:26.393511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] PATH_INFO: `/v3/projects/18b13f67b3e741ddab14265b3de64968/users/6cfa57c3422047d19917e66e6af7c4ca/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:26.395455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b13f67b3e741ddab14265b3de64968, user_id=6cfa57c3422047d19917e66e6af7c4ca, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:26.396870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ef5f2-b253-481e-9012-f6bde60ed408 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:26.409343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 585/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:46:26 2022] PUT /identity/v3/projects/18b13f67b3e741ddab14265b3de64968/users/6cfa57c3422047d19917e66e6af7c4ca/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:46:28.589532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733bf39-47b6-4b5a-b203-3c6082588347 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:28.590104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733bf39-47b6-4b5a-b203-3c6082588347 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:28.590196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733bf39-47b6-4b5a-b203-3c6082588347 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:28.591540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 608/1193] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:46:28.596932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:28.597331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:28.597534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:28.614534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:46:28.615705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:46:28.677964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 586/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:46:28.701238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733bf39-47b6-4b5a-b203-3c6082588347 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:28.798285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733bf39-47b6-4b5a-b203-3c6082588347 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:28.829338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:28.830129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:28.830411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:28.830685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:28.840896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:46:28.848780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:46:28.849893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:46:28.850900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 609/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:46:28.856075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:28.949719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1b68c-3bd8-4f23-8912-81e42de38c5c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:28.981943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:28.982597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:28.982883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:28.983162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:28.983898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:28.984285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:28.985766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:28.993370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 587/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:28.999028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:29.092320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738fb3-3392-44f6-be59-ce919f64d8a6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:29.123685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:29.124527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:29.124845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:29.125116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] PATH_INFO: `/v3/users/6cfa57c3422047d19917e66e6af7c4ca` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:29.126380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] RBAC: Authorizing `identity:get_user(user_id=6cfa57c3422047d19917e66e6af7c4ca)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:29.127796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:29.129370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 610/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 11 05:46:28 2022] GET /identity/v3/users/6cfa57c3422047d19917e66e6af7c4ca => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:29.135006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:29.229832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96115fb-b3bb-473c-9569-bda3c3c53bf8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:29.260755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:29.261387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:29.261956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:29.262231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:29.324578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:29.326150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:29.418194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 588/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:46:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:46:29.424162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:29.516643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7220a-cfd8-4925-ab52-65a2e9049537 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:29.547656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:29.548491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:29.548770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:29.549043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] PATH_INFO: `/v3/projects/18b13f67b3e741ddab14265b3de64968` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:29.550214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=18b13f67b3e741ddab14265b3de64968)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:29.551625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b249403-d506-42a1-bfe2-6b3cd1236ee4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:29.553256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 611/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 11 05:46:29 2022] GET /identity/v3/projects/18b13f67b3e741ddab14265b3de64968 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:46:29.559152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:46:29.652419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b429b-a1b0-42eb-96f4-56820e0e58f9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:46:29.690985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:46:29.691573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:46:29.691858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:46:29.692136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:46:29.692958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=18b13f67b3e741ddab14265b3de64968, user.id=6cfa57c3422047d19917e66e6af7c4ca) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:46:29.693275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:46:29.694734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521c574-9d2a-498e-b14a-338073163075 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:46:29.700365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 589/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:46:29 2022] GET /identity/v3/role_assignments?user.id=6cfa57c3422047d19917e66e6af7c4ca&scope.project.id=18b13f67b3e741ddab14265b3de64968&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:29.717871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b0cd-6a2f-4a77-adeb-d830b13f4c79 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:29.718444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b0cd-6a2f-4a77-adeb-d830b13f4c79 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:29.718444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b0cd-6a2f-4a77-adeb-d830b13f4c79 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:29.720349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 612/1201] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:29.726386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:29.726386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:29.726386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:29.747652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:29.749036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:29.835752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 590/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:29.858891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b0cd-6a2f-4a77-adeb-d830b13f4c79 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:29.988886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b0cd-6a2f-4a77-adeb-d830b13f4c79 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:30.027567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:30.028401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:30.028985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:30.029205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:30.041918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:30.043685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:30.064528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:30.070630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:30.073053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:30.073053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:30.073053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:30.073053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:30.073053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 613/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:30.073383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:30.204805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ff9d-3279-4981-a7ab-46c1a6fa38d3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:30.247420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:30.248006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:30.248291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:30.248631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:30.249405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:30.249807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:30.251176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523e56-7469-4d26-a1d0-b2c571686d89 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:30.270569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 591/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:30.272501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:30.382314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16bb42-f2ce-47ce-a5d2-e9fa121bdb66 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:30.420036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:30.420649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:30.420942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:30.421212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:30.425112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:30.425112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ae75-4f13-4edc-868e-4a085210c094 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:30.445741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 614/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 11 05:47:30 2022] POST /identity/v3/users => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:47:32.854320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0cd7-679d-4904-95bf-e1c182ec6454 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:32.854898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0cd7-679d-4904-95bf-e1c182ec6454 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:32.854898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0cd7-679d-4904-95bf-e1c182ec6454 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:32.857414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 592/1206] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:32.863954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:32.864413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:32.864506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:32.883603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:32.885166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:32.964646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 615/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:32.993726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d0cd7-679d-4904-95bf-e1c182ec6454 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:33.097816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d0cd7-679d-4904-95bf-e1c182ec6454 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:33.138418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:33.138736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:33.139016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:33.139285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:33.150288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:33.158171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:33.159197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:33.165148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 593/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:47:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:47:33.166409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:33.271296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5e18e-7d11-45db-a963-bafa92b4349f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:33.317657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:33.318350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:33.318638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:33.318918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:33.319670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:33.319984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:33.321365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:33.332536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 616/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:47:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:33.338403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:33.472310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eabf8-b6ff-4e78-83aa-971fe59497f5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:33.512851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:33.514198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:33.514485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:33.514847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:33.527502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:33.529847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:33.549231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:33.550409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:33.552019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:33.552019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:33.552019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:33.552019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:33.552019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 594/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:33.556401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:33.670854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f617bb8-81eb-40a1-90be-7dc2420d1840 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:33.708870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:33.709695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:33.709981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:33.710260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:33.711072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:33.711386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:33.712979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:33.729586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 617/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:33.732819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:33.850172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07729-fb7c-452e-816b-7a1fca36343c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:33.884827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:33.885760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:33.886051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:33.886596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:33.896510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:33.897975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:33.913105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:33.914184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:33.915729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 595/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:33.920535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:34.040179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200245d4-f748-4b76-999a-9c419ddaec4e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:34.084365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:34.085039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:34.085351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:34.085682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:34.086661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:34.086957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:34.088616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:34.108459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 618/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:34.113989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:34.230887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b0e4-bdc9-46ce-8281-a3e0f65f5945 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:34.268311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:34.269006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:34.269301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:34.269618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:34.344475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:34.346085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:34.460592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 596/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:47:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:47:34.466815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:34.585417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916872-e10c-4bf7-9395-271a62ea650f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:34.620830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:34.621586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:34.621941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:34.622833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:34.634964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:34.636724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:34.655243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:34.656423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:34.657324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:34.657324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:34.657324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:34.657324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:34.657324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 619/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:34.662443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:34.778640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6aca6-6d95-45c2-a3d1-084798927c17 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:34.814975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:34.815693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:34.816035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:34.816320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:34.817199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:34.817548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:34.819160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:34.839319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 597/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:34.840839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:34.952559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecc9b-d896-41c7-bc60-64e34cb00bfd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:34.999070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:35.000148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:35.000602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:35.001858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:35.007618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:35.009077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:35.022987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:35.023939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:35.024878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 620/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:47:35.030772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:35.138326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9b5c-467f-4f32-aa88-36a3637efc5a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:35.175313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:35.176186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:35.176537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:35.176886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:35.177818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:35.178203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:35.181872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fecf-591c-4673-b230-c134842e9a21 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:35.198534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 598/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:35.200678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:35.308074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b42e-7c99-41d1-9997-b815f219fd8b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:35.345107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:35.345799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:35.346085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:35.346363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:35.347189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=bb48776ee54747dfbab78d9caf1f1fbc) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:35.347502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:35.348946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5b4b0-ad9f-49e0-b195-7b1b50b75441 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:35.354667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 621/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:47:35 2022] GET /identity/v3/role_assignments?user.id=bb48776ee54747dfbab78d9caf1f1fbc&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:37.610067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476aacf-d620-4747-85e5-15e79e06e67f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:37.610638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476aacf-d620-4747-85e5-15e79e06e67f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:37.610638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476aacf-d620-4747-85e5-15e79e06e67f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:37.612614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 599/1220] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:37.618104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:37.618578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:37.618730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:37.635649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:37.637093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:37.706417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 622/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:37.730059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476aacf-d620-4747-85e5-15e79e06e67f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:37.835357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476aacf-d620-4747-85e5-15e79e06e67f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:37.871811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:37.873285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:37.873625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:37.873887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:37.884107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:37.892273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:37.893430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:37.894624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:37.897838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 600/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:47:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:37.899492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.005644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6781b-d6be-45a9-bde5-595d0a087d09 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.045097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.045976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.046359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.046776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.047595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:38.048028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.049570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.064061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 623/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:47:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:38.066604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.178643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30462e36-f169-4e0d-822f-8ccdd8f60923 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.213059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.213886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.214346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.214474 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.225530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.227107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:38.246284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:38.247957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:38.248955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:38.248955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:38.248955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:38.248955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:38.248955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 601/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:38.254864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.353608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4561e5-335d-415e-a77a-1f8e0d318271 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.388170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.388850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.389140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.389422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.390193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:38.390508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.391946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.403956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 624/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:47:38.409685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.512130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e97b-c6c4-4fa8-bf86-6f169fc6c568 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.549661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.550489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.550742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.551011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.560167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.561849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:38.576977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:38.578048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:38.579298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 602/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:38.584016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.694632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e31-8e22-4c6c-a07d-5d0fe523d619 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.730917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.732112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.732112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.732310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.733144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:38.733456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.734923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.753381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 625/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:38.759092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:38.867674 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4843c-f517-4203-a81b-ec38b9fd2e60 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:38.905507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:38.906421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:38.906699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:38.907017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:38.917611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:38.919577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:38.937408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:38.938562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:38.939875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:38.939875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:38.939875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:38.939875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:38.939875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 603/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:47:38.944879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:39.048191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bbd9-7439-4000-b477-4acc7be672af None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:39.082534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:39.083204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:39.083489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:39.083775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:39.084561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:39.084828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:39.086248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:39.098075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 626/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:39.103624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:39.218171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f65f5f-8b4d-4ae1-901b-60261455f9c9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:39.258769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:39.259712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:39.260089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:39.260462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:39.267823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:39.269300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:39.283771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:39.284804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:39.285912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 604/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:39.290945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:39.396429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8f935-e3e5-484d-8c93-2f58f236bf7b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:39.433073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:39.433842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:39.434392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:39.435257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:39.436253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:39.436569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:39.438057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7cc96-3ae1-4c3b-be14-22ad5bf4a8d4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:39.456432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 627/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:47:39.457580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:39.569972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512feb2-9e1e-4a1d-bf3a-1dc4b2e5b682 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:39.610708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:39.611619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:39.611929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:39.612247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/bb48776ee54747dfbab78d9caf1f1fbc/roles/74d92b3b7f28421fbb445eb42edd965d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:39.630196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=bb48776ee54747dfbab78d9caf1f1fbc, role_id=74d92b3b7f28421fbb445eb42edd965d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:39.631632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4244fe-f79d-437f-b4c5-38581b8d9917 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:39.645066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 605/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:47:39 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/bb48776ee54747dfbab78d9caf1f1fbc/roles/74d92b3b7f28421fbb445eb42edd965d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:47:42.006408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71c28-1f5c-40c8-b77a-2f519041aa69 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.007037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71c28-1f5c-40c8-b77a-2f519041aa69 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.007037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71c28-1f5c-40c8-b77a-2f519041aa69 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.008465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 628/1233] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:42.014630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.015166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.015166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.031720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:42.032909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:42.104296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 606/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 05:47:42.128783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71c28-1f5c-40c8-b77a-2f519041aa69 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:42.232205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71c28-1f5c-40c8-b77a-2f519041aa69 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:42.267849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:42.268561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.268885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.269241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.280164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:42.287801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:42.289187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:42.290157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 629/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:42.295751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:42.395625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1caaa0-ee92-43a9-a077-280434623b25 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:42.430372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:42.431084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.431385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.431663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.432425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:42.432740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:42.434751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:42.443142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 607/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:42.449067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:42.561190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fe92-4b25-4e12-b85f-f64ea2d1b76e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:42.604478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:42.605508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.605872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.606272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.618471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:42.619943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:42.643139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:42.644671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:42.646893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:42.646893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:42.646893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:42.646893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:42.646893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 630/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:42.650903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:42.760703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161666e-7487-4fd7-abed-42b06da78751 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:42.796595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:42.797260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.797697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.797990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.798725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:42.799032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:42.800395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:42.812194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 608/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:42.818140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:42.927522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caca65-5c29-48ce-8543-d9b576a15ece None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:42.962937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:42.963738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:42.963993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:42.964271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:42.973768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:42.975254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:42.990002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:42.991161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:42.992098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 631/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:42.997867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:43.104825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c21a2-664e-4847-820f-01bcf899f9b0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:43.141150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:43.141846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:43.142133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:43.142419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:43.143253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:43.143570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:43.145212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:43.169386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 609/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:43.171185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:43.286695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f879-ba25-4a08-8811-5e0ffe1cad26 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:43.326470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:43.327355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:43.327782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:43.328129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:43.399446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:43.401156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:43.507919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 632/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:47:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:47:43.514833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:43.633639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caafe68-2582-4e47-b4be-6284bc33fdb6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:43.670773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:43.671493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:43.671786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:43.672060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:43.682713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:43.684454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:43.705390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:43.706601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:43.707494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:43.707494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:43.707494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:43.707494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:43.707494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 610/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 05:47:43.712362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:43.820274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8e35a-32e6-45e5-b283-f227112bfcd1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:43.855061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:43.855793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:43.856110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:43.856404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:43.857239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:43.857601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:43.858978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:43.871336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 633/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:43.878039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:43.987216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3529da-8e34-47ef-a959-5ba706f602e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:44.024033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:44.024833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:44.025119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:44.025395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:44.034029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:44.035783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:44.050735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:44.051854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:44.053062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 611/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:44.057777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:44.166460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c443c-8acf-451d-b7a2-d747e717ac76 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:44.203384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:44.204078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:44.204362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:44.204637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:44.205429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:44.205771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:44.207452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc749-6339-4f6a-9905-5cd95f9a6159 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:44.220215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 634/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:44.226397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:44.333675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890051-e631-4f14-bd77-6768d85e32de None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:44.368724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:44.369382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:44.369698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:44.369976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:44.370801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] RBAC: Adding query filter params (role.id=74d92b3b7f28421fbb445eb42edd965d, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=bb48776ee54747dfbab78d9caf1f1fbc) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:44.371114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:44.372549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b591-0ebe-4120-a1b1-720c80590386 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:44.378866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 612/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:47:44 2022] GET /identity/v3/role_assignments?user.id=bb48776ee54747dfbab78d9caf1f1fbc&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=74d92b3b7f28421fbb445eb42edd965d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:46.716164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859adfb6-7e61-4586-ae5e-92e234d8a67e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:46.716743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859adfb6-7e61-4586-ae5e-92e234d8a67e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:46.716743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859adfb6-7e61-4586-ae5e-92e234d8a67e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:46.718431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 635/1247] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:46.723977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:46.724473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:46.724549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:46.743229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:46.744553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:46.820787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 613/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:46.844810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859adfb6-7e61-4586-ae5e-92e234d8a67e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:46.951691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859adfb6-7e61-4586-ae5e-92e234d8a67e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:46.990735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:46.991538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:46.991824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:46.992119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.004615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:47.014003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:47.015146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:47.016265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 636/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:47.021869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.128423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a45cee-a3fe-4717-a5f7-9740519efc1c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:47.165318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:47.166025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:47.166417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:47.166810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.167627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:47.168028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:47.170330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:47.182045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 614/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:47.186781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.290217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4044dd-6a6a-47f0-b8cf-c4ac15ad2be2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:47.323227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:47.324040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:47.324322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:47.325105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.337798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:47.339270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:47.360802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:47.361964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:47.363171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:47.363171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:47.363171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:47.363171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:47.363171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 637/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:47.368073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.468613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c9532-92db-4ea2-a40c-211853db991f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:47.506177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:47.506841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:47.507124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:47.507402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.508140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:47.508502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:47.510005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:47.529537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 615/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:47.533593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.657056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f2e1-0e18-4b37-9a5b-acc22430879d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:47.691650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:47.692452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:47.692733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:47.693020 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.701228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:47.702770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:47.717042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:47.718549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:47.719477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 638/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:47.724155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.832142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d6d7-b2cf-4679-848e-cb6635129cff None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:47.867015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:47.867682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:47.867972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:47.868255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:47.869097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:47.869407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:47.870868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:47.889963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 616/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:47.895838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:47.998869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b76e7-1e8a-4f1b-8c17-ab6eb4525414 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:48.031957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:48.032600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:48.032908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:48.033185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:48.101578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:48.103317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:48.207627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 639/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:47:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:47:48.214100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:48.319548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3e37-fa25-4f5d-860f-4eac8e5fc37c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:48.354950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:48.356533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:48.356892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:48.357205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:48.368402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:48.369884 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:48.390833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:48.391813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:48.392721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:48.392721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:48.392721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:48.392721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:48.392721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 617/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:48.397916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:48.503309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5cf04-18e4-4a94-9697-c7e8b9bc4187 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:48.550055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:48.550984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:48.551278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:48.552032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:48.552696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:48.553033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:48.554736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:48.576525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 640/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:47:48.580919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:48.686004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf973c-b5f6-4e56-a346-a7489c0102a4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:48.720911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:48.721765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:48.722052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:48.722337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:48.729891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:48.732011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:48.747159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:48.748385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:48.749427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 618/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:48.754912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:48.855622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7528f-bf3c-492e-83a4-3d0c5904b80b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:48.889305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:48.889985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:48.890271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:48.890546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:48.891317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:48.891624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:48.893043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486eec2-6248-4494-9d4a-1101a8dcb00a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:48.904903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 641/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:48.911168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:49.013569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3c75-6d62-4232-a66f-7890b7464103 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:49.046778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:49.047435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:49.047713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:49.047988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:49.048816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=bb48776ee54747dfbab78d9caf1f1fbc) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:49.049127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:49.050588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8fa4-55e8-4f3a-9d3b-2f0237aea431 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:49.056135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 619/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:47:48 2022] GET /identity/v3/role_assignments?user.id=bb48776ee54747dfbab78d9caf1f1fbc&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:51.249711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80532c-ab05-4143-84c7-dea0594e29a4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.250230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80532c-ab05-4143-84c7-dea0594e29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.250321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80532c-ab05-4143-84c7-dea0594e29a4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.251657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 642/1261] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:51.256844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.257223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.257415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.274461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:51.275659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:51.337970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 620/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:51.360140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80532c-ab05-4143-84c7-dea0594e29a4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:51.454853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80532c-ab05-4143-84c7-dea0594e29a4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:51.485883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:51.486645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.486923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.487198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.497186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:51.504634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:51.505849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:51.506890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 643/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:51.511856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:51.626333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac353-f46e-413d-8193-2a67f600542a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:51.657999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:51.658658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.658945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.659224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.659964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:51.660273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:51.661697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:51.670022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 621/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:51.675816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:51.768524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033637-2f93-42d9-80e6-4647ac35f1ad None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:51.799722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:51.800486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.800766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.801039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.811592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:51.813056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:51.829125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:51.830179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:51.831126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:51.831126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:51.831126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:51.831126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:51.831126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 644/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:51.835888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:51.930621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7773-bd02-4bc5-b91c-433c39952fba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:51.962907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:51.963560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:51.963852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:51.964141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:51.964858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:51.965722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:51.967085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:51.978238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 622/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:51.984315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.076267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017118b-81a1-4a29-9617-93d7049d4fab None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.107191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.107964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.108246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.108521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.116305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.117759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:52.131999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:52.133136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:52.134318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 645/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:52.139529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.232804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310cf0-9e1b-4732-9700-605d3f293568 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.265792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.266448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.266726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.266999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.267819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:52.268126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.269554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.285709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 623/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:52.291414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.388911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91a760-ce4e-4483-b849-ce37f3ed45a3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.420244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.421014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.421294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.421597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.431407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.432832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:52.450011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:52.450995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:52.452249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:52.452249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:52.452249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:52.452249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:52.452249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 646/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:52.456785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.553853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e74c-f7f4-47d5-b0ef-c9e855e7d96b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.586871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.587522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.587803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.588080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.588788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:52.589093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.591289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.601862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 624/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:52.607536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.702235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123625-69dd-4a14-bbf4-fdbd077d1d51 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.734033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.734810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.735093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.735370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.741686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.743113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:52.757195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:52.758322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:52.759352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 647/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:52.764915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:52.856365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee6aee-8131-4c68-a22b-0e6fffdd12f6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:52.887890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:52.888537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:52.888820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:52.889099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:52.889910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:52.890226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:52.891634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1377a1-b5f3-46bf-bc4e-67f0cfe81f10 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:52.903754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 625/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:52.909592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:53.002789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db1068-476c-4aa6-8670-e06308b96cb6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:53.034728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:53.035596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:53.035881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:53.036159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] PATH_INFO: `/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/bb48776ee54747dfbab78d9caf1f1fbc/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:53.038100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a65dbd124234f9eb1215aabf56bfc06, user_id=bb48776ee54747dfbab78d9caf1f1fbc, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:53.039523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53306da-59f4-47af-ab98-625037e94b58 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:53.051921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 648/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 11 05:47:52 2022] PUT /identity/v3/projects/3a65dbd124234f9eb1215aabf56bfc06/users/bb48776ee54747dfbab78d9caf1f1fbc/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:47:55.225710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f29ff-9531-4d51-aadf-a6728fa87ab7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.226177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f29ff-9531-4d51-aadf-a6728fa87ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.226269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f29ff-9531-4d51-aadf-a6728fa87ab7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.227636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 626/1274] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:55.232844 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.233280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.233401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.250028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:55.251182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:55.313440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 649/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:55.337170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f29ff-9531-4d51-aadf-a6728fa87ab7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:55.432091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f29ff-9531-4d51-aadf-a6728fa87ab7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:55.463818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:55.464537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.464820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.465673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.475214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 05:47:55.483209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:55.484262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:55.485533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 627/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 11 05:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:55.490178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:55.586929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325519f-855b-4162-a99e-0ef31040c470 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:55.619509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:55.620166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.620449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.620725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.621630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:55.622078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:55.623558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:55.631174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 650/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 11 05:47:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:55.637552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:55.731339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900cdb-a8b8-4ae9-9532-be2997b2f324 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:55.762532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:55.763293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.763574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.763849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.773836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:55.775357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:55.791984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:55.792960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:55.794269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:55.794269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:55.794269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:55.794269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:55.794269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 628/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:55.798940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:55.893738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b32f-bad3-4a89-b566-7c77abb6e630 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:55.924504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:55.925146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:55.925431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:55.925738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:55.926450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:55.926756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:55.928117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:55.939916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 651/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:55.945445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.041984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13c6a-675a-4ab0-9a2b-23c469c4f87a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.075482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.076269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.076560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.076843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:56.084714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:56.086186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 05:47:56.100556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:56.101677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:56.102669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 629/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:56.108405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.201917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ee3a-eeac-41cc-b28f-87d0d2aff0d6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.233597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.234242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.234523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.234800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:56.235630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:56.235942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:56.237367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:56.254240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 652/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 11 05:47:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:56.259886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.353681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ac3f-5622-4e2b-a5e9-6e9f5eeeeae6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.389989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.391096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.391602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.392115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:56.455479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:56.456926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:56.554551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 630/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 11 05:47:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 05:47:56.560291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.653549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c1c2-9b4e-4d32-ab5e-8e2b334bea5d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.685728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.686511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.686798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.687078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:56.696545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:56.698027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 05:47:56.716115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:56.717145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:56.718155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 05:47:56.718155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 05:47:56.718155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 05:47:56.718155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:56.718155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 653/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:56.722875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.815879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafce447-28e6-4e52-a12a-393fae803c9f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.848254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.848905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.849189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.849465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:56.850195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:56.850502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:56.851858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:56.862760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 631/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 11 05:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:56.868356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:56.963314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359257f2-882d-4ee0-8d01-524493ad334b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:56.995138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:56.995916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:56.996294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:56.996745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:57.003092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:57.004520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 05:47:57.018550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:57.019555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 11 05:47:57.020618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 654/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 11 05:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:57.025303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:57.118730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6eea8-e674-4c6e-a608-8bf37be793e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:57.150404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:57.151051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:57.151336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:57.151613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:57.152922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:57.153237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:57.154706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67ff2-5a02-42e2-a1a4-ecceac5257c3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:57.166051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 632/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 11 05:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:57.171908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:57.266861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ef0dc-ad6f-4530-9926-cc15f394a561 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:57.297233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:57.297895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:57.298176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:57.298446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:57.299255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] RBAC: Adding query filter params (role.id=9086c2b2021041caa06abc9556a262a5, scope.project.id=3a65dbd124234f9eb1215aabf56bfc06, user.id=bb48776ee54747dfbab78d9caf1f1fbc) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:57.299560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:57.300963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa486f-9cfa-4d40-835a-592760294148 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:57.306476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 655/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 11 05:47:57 2022] GET /identity/v3/role_assignments?user.id=bb48776ee54747dfbab78d9caf1f1fbc&scope.project.id=3a65dbd124234f9eb1215aabf56bfc06&role.id=9086c2b2021041caa06abc9556a262a5 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:59.531682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139795-3b33-4357-a1e0-0606cb593b03 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:59.532216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139795-3b33-4357-a1e0-0606cb593b03 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:59.532311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139795-3b33-4357-a1e0-0606cb593b03 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:59.534013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 633/1288] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:47:59.539954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:59.540382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:59.540510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:59.558090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:47:59.559469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:47:59.626236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 656/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:47:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:47:59.647935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139795-3b33-4357-a1e0-0606cb593b03 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:59.744091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139795-3b33-4357-a1e0-0606cb593b03 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:59.776430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:59.777752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:59.778032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:59.778462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:59.779116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:59.780475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:47:59.792024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:47:59.793710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:47:59.794587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 634/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:47:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:47:59.800157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:47:59.894584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3417a0-92d6-4899-b68a-72f49ae572f8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:47:59.926534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:47:59.927178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:47:59.927459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:47:59.927731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:47:59.928425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:47:59.928730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:47:59.930107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9c7f-499d-4e11-af1e-71cbe565c924 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:47:59.934648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 657/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 11 05:47:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:47:59.940250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:00.032994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c667da-74bd-4847-a684-ce25b62e8d1f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:00.063534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:00.064123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:00.064405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:00.064681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:00.065372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] RBAC: Adding query filter params (type=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:48:00.065709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:00.067058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff404ae5-4e72-41b1-8885-fbcce7a5b8ac None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:00.071204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 635/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 11 05:47:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:48:02.262142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be66-d2a7-4e8d-a6da-153575a83c42 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:02.262613 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be66-d2a7-4e8d-a6da-153575a83c42 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:02.262700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90be66-d2a7-4e8d-a6da-153575a83c42 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:02.264055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 658/1293] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:48:02.269220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a8e2-4232-403e-81af-dba5d10bd7a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:02.269655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a8e2-4232-403e-81af-dba5d10bd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:02.269805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a8e2-4232-403e-81af-dba5d10bd7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:02.285932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f688a8e2-4232-403e-81af-dba5d10bd7a1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:48:02.287097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f688a8e2-4232-403e-81af-dba5d10bd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:48:02.349268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 636/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:48:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:48:02.372649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90be66-d2a7-4e8d-a6da-153575a83c42 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:02.475599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90be66-d2a7-4e8d-a6da-153575a83c42 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:02.507420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:02.508073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:02.508359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:02.508640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:02.509353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:02.510745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e4ec2-42be-44d5-aba2-d1c072cafa00 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:02.524373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 659/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 11 05:48:02 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:48:04.709172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fda15-4785-4cbe-81b9-61ab1ba66662 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:04.709776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fda15-4785-4cbe-81b9-61ab1ba66662 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:04.709776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fda15-4785-4cbe-81b9-61ab1ba66662 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:04.711147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 637/1296] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:48:04.716895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:04.717312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:04.717569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:04.733871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:48:04.735039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:48:04.803261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 660/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:48:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:48:04.826616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fda15-4785-4cbe-81b9-61ab1ba66662 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:04.920520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fda15-4785-4cbe-81b9-61ab1ba66662 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:04.952194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:04.952966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:04.953247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:04.953549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:04.954191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:04.955538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:48:04.967297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:48:04.968444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:04.969633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 638/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:48:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:48:04.974319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:05.067864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a76847-c3bf-48b3-9621-4a92a18f1aac None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:05.100082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:05.100724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:05.101006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:05.101289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:05.102014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:48:05.102319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:05.103669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:05.109006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 661/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 11 05:48:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:48:05.114732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:05.211954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32a816-3a6d-4954-ab4c-f54b15ed4b5c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:05.243606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:05.244254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:05.244541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:05.244822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:05.245633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] RBAC: Adding query filter params (interface=public, service_id=6c1d4b8f6db14ad89b22144929721711, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:48:05.246583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:05.248035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa907c4-5cd1-4d39-9cf5-165142d79b46 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:05.252825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 639/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 11 05:48:05 2022] GET /identity/v3/endpoints?service_id=6c1d4b8f6db14ad89b22144929721711&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:48:05.258355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:05.351320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a143c-aca9-4e9c-946e-089fb0246b7b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:05.383419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:05.384060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:05.384340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:05.384614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:05.385282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:05.386988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4014ed-a725-4bad-9ec8-8d10cec7dd30 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:05.393462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 662/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 11 05:48:05 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:48:07.571089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcccf-ed69-4777-a4b1-2592ab4bf702 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:07.571607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcccf-ed69-4777-a4b1-2592ab4bf702 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:07.571701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcccf-ed69-4777-a4b1-2592ab4bf702 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:07.573002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 640/1302] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:48:07.578709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:07.579109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:07.579254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:07.595897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:48:07.597055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:48:07.659236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 663/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:48:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 05:48:07.682533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dcccf-ed69-4777-a4b1-2592ab4bf702 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:07.782364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dcccf-ed69-4777-a4b1-2592ab4bf702 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:07.813942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:07.814717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:07.815003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:07.815282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:07.815921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:07.817288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 05:48:07.829495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 05:48:07.830644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 11 05:48:07.831508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 641/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 11 05:48:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 05:48:07.836521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:07.927955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6490732-54a8-4f44-91c1-eadfff369735 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:07.959641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:07.960322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:07.960606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:07.960880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:07.961601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:48:07.961908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:07.963269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a2985-b7a1-499c-bf6f-dd4fd44bc8e3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:07.968294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 664/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 11 05:48:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:48:07.973838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:48:08.071355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed73347-952f-4b2e-bd39-24e9531838d6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:48:08.102663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:48:08.103246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:48:08.103544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:48:08.103889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:48:08.104625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:48:08.106594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea39cda-d046-42b1-87d3-9c613139974c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:48:08.124110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 642/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 11 05:48:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:49:11.405242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9bbb-7126-49f6-864f-d53428f34435 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:11.405717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9bbb-7126-49f6-864f-d53428f34435 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:11.405870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9bbb-7126-49f6-864f-d53428f34435 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:11.411261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 665/1307] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:11.416603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f700-08b2-4dbe-81d0-39966e7f26e9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:11.418629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f700-08b2-4dbe-81d0-39966e7f26e9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:11.420004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f700-08b2-4dbe-81d0-39966e7f26e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:11.518785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2032f700-08b2-4dbe-81d0-39966e7f26e9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:11.519993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2032f700-08b2-4dbe-81d0-39966e7f26e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:11.712079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 643/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:49:11.762823 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:11.763109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:11.763579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:11.765652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 666/1309] 10.222.0.44 () {54 vars in 964 bytes} [Wed May 11 05:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:11.772036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b5b2-1052-4114-a355-e52b6bea73fe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:11.772394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b5b2-1052-4114-a355-e52b6bea73fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:11.772827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b5b2-1052-4114-a355-e52b6bea73fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:11.854594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1f83b5b2-1052-4114-a355-e52b6bea73fe None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:11.855808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1f83b5b2-1052-4114-a355-e52b6bea73fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:11.934656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 644/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Wed May 11 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:49:11.943745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:11.945666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:12.063548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1174c-39b2-431f-90b2-3a1407896836 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:12.138380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:12.139035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:12.139322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:12.139604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:12.141243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:12.255718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:12.257437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2825db-0b69-428a-b761-e2a9c4ec7c61 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:12.277703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 667/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:14.820744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:14.821348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:14.821667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:14.827920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 645/1312] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:14.828984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7f500-ca21-48e2-962f-0089ed94565b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:14.829403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7f500-ca21-48e2-962f-0089ed94565b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:14.829694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7f500-ca21-48e2-962f-0089ed94565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:14.912228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-47a7f500-ca21-48e2-962f-0089ed94565b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:14.913686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-47a7f500-ca21-48e2-962f-0089ed94565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:15.027481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 668/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:49:15.067364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:15.068989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:15.182340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ed2ff-228e-4b3f-9674-6686f5c974dc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:15.252550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:15.253203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:15.253502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:15.253786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:15.255402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:15.364688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:15.366177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a3912-e6cb-41fb-bbea-965077da59f1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:15.384592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 646/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:17.904153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:17.904677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:17.904677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:17.905995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 669/1315] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 05:49:17.911075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bed8-4fd5-4cf4-a0c1-6358979fbf66 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:17.911500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bed8-4fd5-4cf4-a0c1-6358979fbf66 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:17.911635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bed8-4fd5-4cf4-a0c1-6358979fbf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:17.973168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1e49bed8-4fd5-4cf4-a0c1-6358979fbf66 None None] MFA Rules not processed for user `36f404a5c807416aa172abb7a3dc43fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:17.974391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1e49bed8-4fd5-4cf4-a0c1-6358979fbf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:18.065091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 647/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:18.104886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:18.106482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:18.206063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339fd93-1158-41d0-8dc0-605cd31fcdf7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:18.276851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:18.277508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:18.277797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:18.278074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:18.279699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:18.382479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:18.384621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab6304-b948-44bb-9f82-3ff447e073a3 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:18.403639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 670/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:21.124877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:21.125584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:21.125584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:21.126816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 648/1318] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:21.132055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d4f5-756a-409d-b9ff-c9f378dfaa19 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:21.132463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d4f5-756a-409d-b9ff-c9f378dfaa19 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:21.132620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69d4f5-756a-409d-b9ff-c9f378dfaa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:21.196931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5b69d4f5-756a-409d-b9ff-c9f378dfaa19 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:21.198197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5b69d4f5-756a-409d-b9ff-c9f378dfaa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:21.290287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 671/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:21.328942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:21.330520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:21.429507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713c3fd-4d5b-4417-9735-22f31f5665dc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:21.499434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:21.500067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:21.500348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:21.500622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:21.502261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:21.610021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:21.611455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33083fa3-9653-4297-8791-c02333ccd144 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:21.629000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 649/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:24.490061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:24.490609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:24.490715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:24.492010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 672/1321] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:24.497997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99037a-de6b-4c9f-bb76-decef05febcb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:24.498409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99037a-de6b-4c9f-bb76-decef05febcb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:24.498561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99037a-de6b-4c9f-bb76-decef05febcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:24.561936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2b99037a-de6b-4c9f-bb76-decef05febcb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:24.563117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2b99037a-de6b-4c9f-bb76-decef05febcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:24.655214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 650/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:24.690352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:24.691931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:24.792349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71c67b-b3f3-4c06-b80e-828543686ba8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:24.865255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:24.866087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:24.866372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:24.866651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:24.868492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:24.973015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:24.974482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faee3d-cdce-4a26-b599-bd471fd3bc29 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:24.992021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 673/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:27.309501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:27.310076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:27.310076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:27.311608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 651/1324] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:27.316602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e756c-0586-4e2d-8375-4528a29ad21b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:27.317050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e756c-0586-4e2d-8375-4528a29ad21b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:27.317167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e756c-0586-4e2d-8375-4528a29ad21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:27.381041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-239e756c-0586-4e2d-8375-4528a29ad21b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:27.382263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-239e756c-0586-4e2d-8375-4528a29ad21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:27.474007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 674/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:27.509398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:27.511173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:27.612475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a687-97dd-46da-8e9e-e713ffc953ed None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:27.682959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:27.683733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:27.684018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:27.684322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:27.685987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:27.788802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:27.791178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86bf83-9793-468a-a73c-4c6a0fff9139 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:27.809255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 652/1326] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:30.068619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:30.069190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:30.069190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:30.071242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 675/1327] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:30.076403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471c64-b2fe-4434-a639-f53bda4d5aad None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:30.076810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471c64-b2fe-4434-a639-f53bda4d5aad None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:30.076969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471c64-b2fe-4434-a639-f53bda4d5aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:30.139294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e6471c64-b2fe-4434-a639-f53bda4d5aad None None] MFA Rules not processed for user `36f404a5c807416aa172abb7a3dc43fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:30.140478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6471c64-b2fe-4434-a639-f53bda4d5aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:30.233545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 653/1328] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:30.269803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:30.271319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:30.372023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1885f4-96aa-49a1-974b-4d246c8927a5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:30.445885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:30.446535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:30.446820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:30.447097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:30.448732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:30.557497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:30.558975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cdc2d-d3ab-4954-9d66-23978b6ebe7c service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:30.578007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 676/1329] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:33.124466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:33.124466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:33.124466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:33.125976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 654/1330] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:33.128453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa979e7-7ea1-4302-8635-b0a4ecacc511 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:33.128898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa979e7-7ea1-4302-8635-b0a4ecacc511 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:33.129000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa979e7-7ea1-4302-8635-b0a4ecacc511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:33.205146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2fa979e7-7ea1-4302-8635-b0a4ecacc511 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:33.206441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2fa979e7-7ea1-4302-8635-b0a4ecacc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:33.311181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 677/1331] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:33.353848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:33.355347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:33.455857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9311-4a64-42f0-a89c-eb5acc2eec20 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:33.528478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:33.528969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:33.529252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:33.529556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:33.531319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:33.644390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:33.645869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8943317-b1ff-483f-a4dc-4e032c534a74 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:33.663869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 655/1332] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:35.948109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:35.948638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:35.948638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:35.949990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 678/1333] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:35.955075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820cb64-ac7e-49e2-9741-4b68543781b4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:35.955521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820cb64-ac7e-49e2-9741-4b68543781b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:35.955624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820cb64-ac7e-49e2-9741-4b68543781b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:36.018033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4820cb64-ac7e-49e2-9741-4b68543781b4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:36.019227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4820cb64-ac7e-49e2-9741-4b68543781b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:36.115675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 656/1334] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:36.154764 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:36.156321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:36.256846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720329e-aa55-4910-b523-783cb08d2b91 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:36.325520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:36.326157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:36.326438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:36.326714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:36.328307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:36.431886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:36.433324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546da5e-1e80-484a-96e2-3d0afe81aad3 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:36.451090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 679/1335] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:38.933433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba94f-a8a5-46c1-9d5d-f3aae2651fe1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:38.934035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba94f-a8a5-46c1-9d5d-f3aae2651fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:38.934035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba94f-a8a5-46c1-9d5d-f3aae2651fe1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:38.935403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 657/1336] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:38.940517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eea7-a977-4c18-8240-c819bf1bb735 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:38.940943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eea7-a977-4c18-8240-c819bf1bb735 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:38.941081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eea7-a977-4c18-8240-c819bf1bb735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:39.004148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6b85eea7-a977-4c18-8240-c819bf1bb735 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:39.005367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b85eea7-a977-4c18-8240-c819bf1bb735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:39.100671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 680/1337] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:39.152958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:39.153247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:39.153562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:39.154933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 658/1338] 10.222.0.44 () {54 vars in 964 bytes} [Wed May 11 05:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:39.161183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb087f-037f-4869-9669-0e7cb6278b2f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:39.161600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb087f-037f-4869-9669-0e7cb6278b2f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:39.161887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb087f-037f-4869-9669-0e7cb6278b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:39.234481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-eddb087f-037f-4869-9669-0e7cb6278b2f None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:39.235692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-eddb087f-037f-4869-9669-0e7cb6278b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:39.308652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 681/1339] 10.222.0.44 () {58 vars in 1061 bytes} [Wed May 11 05:49:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:39.317857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:39.319405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:39.420662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f604b-c9f1-4895-a5d1-595e91a65a5f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:39.493293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:39.493981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:39.494272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:39.494558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:39.496178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:39.603726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:39.605166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f22d4e-8c61-4aab-bb47-fe7e6972dca9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:39.623012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 659/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:49:44.359925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:44.360520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:44.360520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:44.361925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 682/1341] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:44.367348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968b27-b739-4acd-96f1-bc48bf4313df None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:44.367788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968b27-b739-4acd-96f1-bc48bf4313df None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:44.368037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968b27-b739-4acd-96f1-bc48bf4313df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:44.437226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-82968b27-b739-4acd-96f1-bc48bf4313df None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:44.438361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-82968b27-b739-4acd-96f1-bc48bf4313df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:44.541521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 660/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:44.579932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:44.582042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:44.675240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d4f1-4a0d-42cb-94b3-da3d2fbc126c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:44.678825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:44.680025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:44.680311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:44.680672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:44.689589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:44.691026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aefd14-514e-4a1b-91db-7d4f2acc7fd3 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:44.700847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 683/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:49:47.521442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0746fc-2d52-4fcc-b61d-c2987fff0c90 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:47.521989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0746fc-2d52-4fcc-b61d-c2987fff0c90 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:47.522082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0746fc-2d52-4fcc-b61d-c2987fff0c90 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:47.523460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 661/1344] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:47.528750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cc936-631c-4ef9-8988-66c74a651842 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:47.529185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cc936-631c-4ef9-8988-66c74a651842 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:47.529554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cc936-631c-4ef9-8988-66c74a651842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:47.559922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d4cc936-631c-4ef9-8988-66c74a651842 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:47.561188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d4cc936-631c-4ef9-8988-66c74a651842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:47.636500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 684/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:47.672665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0746fc-2d52-4fcc-b61d-c2987fff0c90 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:47.684205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0746fc-2d52-4fcc-b61d-c2987fff0c90 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:47.687739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:47.688381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:47.688667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:47.688945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:47.698692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:47.700138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c65b5-7149-4b07-b5bb-faea325bacba service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:47.709437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 662/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:51.922958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:51.923494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:51.923494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:51.924873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 685/1347] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:51.930177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc418c7-8f47-4c9e-9a99-cfe24e290375 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:51.930577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc418c7-8f47-4c9e-9a99-cfe24e290375 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:51.930742 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc418c7-8f47-4c9e-9a99-cfe24e290375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:51.948502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0bc418c7-8f47-4c9e-9a99-cfe24e290375 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:51.949729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0bc418c7-8f47-4c9e-9a99-cfe24e290375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:51.957414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 663/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:49:51.994625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:49:51.996364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:52.009821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e35e-22b1-475f-8499-888137d81dca None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:49:52.013627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:49:52.014265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:52.014550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:52.014828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:52.023543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:49:52.024968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5c53-ecc5-4139-a5fd-e18e6e4f651d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:49:52.034077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 686/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:49:57.397010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de21e-3891-4492-b1fc-f13b1186b812 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:57.398628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de21e-3891-4492-b1fc-f13b1186b812 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:57.399190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de21e-3891-4492-b1fc-f13b1186b812 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:57.401045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 664/1350] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:49:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:49:57.406190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058994d-2909-417d-a98e-b075b40731e2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:49:57.406620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058994d-2909-417d-a98e-b075b40731e2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:49:57.406753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058994d-2909-417d-a98e-b075b40731e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:49:57.477349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6058994d-2909-417d-a98e-b075b40731e2 None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:49:57.478680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6058994d-2909-417d-a98e-b075b40731e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:49:57.562657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 687/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:49:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:01.910444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356906-4563-443f-9bff-cfaae64fc4fe None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:01.910938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356906-4563-443f-9bff-cfaae64fc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:01.910938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356906-4563-443f-9bff-cfaae64fc4fe None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:01.912453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 665/1352] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:01.917388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08151-ab2a-40fd-a926-3ae647cc868e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:01.918172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08151-ab2a-40fd-a926-3ae647cc868e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:01.918607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08151-ab2a-40fd-a926-3ae647cc868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:01.940534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-41e08151-ab2a-40fd-a926-3ae647cc868e None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:01.942017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-41e08151-ab2a-40fd-a926-3ae647cc868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:01.953183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 688/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:50:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:03.573811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728e4fa-cf8c-4a88-8137-3f3f4a51e420 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:03.574295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728e4fa-cf8c-4a88-8137-3f3f4a51e420 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:03.574421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728e4fa-cf8c-4a88-8137-3f3f4a51e420 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:03.575764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 666/1354] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:03.580928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395c83-738b-4528-8d00-eb9cfed43ce6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:03.581344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395c83-738b-4528-8d00-eb9cfed43ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:03.581540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395c83-738b-4528-8d00-eb9cfed43ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:03.599692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0d395c83-738b-4528-8d00-eb9cfed43ce6 None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:03.600869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0d395c83-738b-4528-8d00-eb9cfed43ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:03.609714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 689/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:07.473340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f207c-ffd5-453f-8856-42b51b6e705c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:07.473880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f207c-ffd5-453f-8856-42b51b6e705c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:07.473880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f207c-ffd5-453f-8856-42b51b6e705c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:07.475355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 667/1356] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:07.480932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e63a2-a39f-4ec7-9005-39251046c176 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:07.481328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e63a2-a39f-4ec7-9005-39251046c176 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:07.481530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e63a2-a39f-4ec7-9005-39251046c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:07.500817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-683e63a2-a39f-4ec7-9005-39251046c176 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:07.502049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-683e63a2-a39f-4ec7-9005-39251046c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:07.511458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 690/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:07.564294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214386-42c6-479a-8596-c038bcb7a684 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:07.564585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214386-42c6-479a-8596-c038bcb7a684 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:07.564892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214386-42c6-479a-8596-c038bcb7a684 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:07.567520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 668/1358] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 11 05:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:07.574780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd921f6-3a20-4507-810d-5532b75ba7d7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:07.575383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd921f6-3a20-4507-810d-5532b75ba7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:07.575977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd921f6-3a20-4507-810d-5532b75ba7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:07.623976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-edd921f6-3a20-4507-810d-5532b75ba7d7 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:07.625263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-edd921f6-3a20-4507-810d-5532b75ba7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:07.706218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 691/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 11 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:07.714895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e214386-42c6-479a-8596-c038bcb7a684 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:07.729305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e214386-42c6-479a-8596-c038bcb7a684 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:07.734661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:07.735369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:07.735726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:07.736163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:07.744920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:07.746651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32076e-d277-4937-ba9e-e1a3b4618e36 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:07.756063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 669/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:10.200035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e75d-a795-4abc-8ce3-cfad93ee7042 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:10.200491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e75d-a795-4abc-8ce3-cfad93ee7042 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:10.200595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e75d-a795-4abc-8ce3-cfad93ee7042 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:10.202177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 692/1361] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:10.207255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffd533-a1e8-4d8c-8bbc-dfa466d75d5a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:10.207660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffd533-a1e8-4d8c-8bbc-dfa466d75d5a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:10.207818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffd533-a1e8-4d8c-8bbc-dfa466d75d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:10.225505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d7ffd533-a1e8-4d8c-8bbc-dfa466d75d5a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:10.226907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d7ffd533-a1e8-4d8c-8bbc-dfa466d75d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:10.237817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 670/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:10.280281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5e75d-a795-4abc-8ce3-cfad93ee7042 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:10.294724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5e75d-a795-4abc-8ce3-cfad93ee7042 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:10.300215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:10.300861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:10.301149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:10.301429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:10.310373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:10.311957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d5cc0-4e14-43dc-965e-8744d6470fd4 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:10.322365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 693/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:12.862643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56cdc-55a0-445b-92e7-d586cca67f12 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:12.863189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56cdc-55a0-445b-92e7-d586cca67f12 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:12.863189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56cdc-55a0-445b-92e7-d586cca67f12 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:12.864643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 671/1364] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:12.869992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80335-e4cf-4602-ba8a-a2434917be53 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:12.870419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80335-e4cf-4602-ba8a-a2434917be53 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:12.870535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf80335-e4cf-4602-ba8a-a2434917be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:12.888688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8cf80335-e4cf-4602-ba8a-a2434917be53 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:12.889895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8cf80335-e4cf-4602-ba8a-a2434917be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:12.904165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 694/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:12.948819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9e70-cc1e-4037-acfd-41fbd0e9b7b3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:12.949650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9e70-cc1e-4037-acfd-41fbd0e9b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:12.950248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9e70-cc1e-4037-acfd-41fbd0e9b7b3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:12.951708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 672/1366] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 11 05:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:12.956927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252333-829a-489b-905c-8f8f1539b86c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:12.957218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252333-829a-489b-905c-8f8f1539b86c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:12.957511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252333-829a-489b-905c-8f8f1539b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:12.978318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-34252333-829a-489b-905c-8f8f1539b86c None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:12.979513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-34252333-829a-489b-905c-8f8f1539b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:12.988775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 695/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 11 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:13.001495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9e70-cc1e-4037-acfd-41fbd0e9b7b3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:13.021835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9e70-cc1e-4037-acfd-41fbd0e9b7b3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:13.027624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:13.028289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:13.028585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:13.028868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:13.037872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:13.039919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71511cd-d71d-4f09-a534-e07ca0130d84 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:13.050368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 673/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:15.362332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e5ed-832a-4551-96a0-979de714d8cd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:15.362857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e5ed-832a-4551-96a0-979de714d8cd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:15.362857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e5ed-832a-4551-96a0-979de714d8cd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:15.364257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 696/1369] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:15.370480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c72eb6-9c85-4365-ba11-c934d9079d95 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:15.370911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c72eb6-9c85-4365-ba11-c934d9079d95 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:15.371153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c72eb6-9c85-4365-ba11-c934d9079d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:15.389455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-20c72eb6-9c85-4365-ba11-c934d9079d95 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:15.390686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-20c72eb6-9c85-4365-ba11-c934d9079d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:15.399007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 674/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:15.442661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e5ed-832a-4551-96a0-979de714d8cd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:15.458533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e5ed-832a-4551-96a0-979de714d8cd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:15.464638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:15.465570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:15.466049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:15.466537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:15.475223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:15.477325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfdda-eac5-4479-aac2-ee704d896e67 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:15.487101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 697/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:15.730792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229ac0-3b8f-49ba-b76e-5e47926e79f6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:15.731091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229ac0-3b8f-49ba-b76e-5e47926e79f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:15.731561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229ac0-3b8f-49ba-b76e-5e47926e79f6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:15.733239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 675/1372] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:15.740122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06b47-e397-436c-9adc-96ce64be1ec9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:15.740568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06b47-e397-436c-9adc-96ce64be1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:15.741067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06b47-e397-436c-9adc-96ce64be1ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:15.762065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-41c06b47-e397-436c-9adc-96ce64be1ec9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:15.763293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-41c06b47-e397-436c-9adc-96ce64be1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:15.773524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 698/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:16.100183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385a111-c9a0-4338-87a5-cee395804c80 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:16.100351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385a111-c9a0-4338-87a5-cee395804c80 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:16.100635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385a111-c9a0-4338-87a5-cee395804c80 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:16.105516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 676/1374] 10.222.0.44 () {54 vars in 963 bytes} [Wed May 11 05:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:16.108751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2e4f-142c-4a6b-bd0b-29315c022c55 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:16.109042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2e4f-142c-4a6b-bd0b-29315c022c55 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:16.109328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2e4f-142c-4a6b-bd0b-29315c022c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:16.159587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-830c2e4f-142c-4a6b-bd0b-29315c022c55 None None] MFA Rules not processed for user `8a422e2a9c3640e888f2743aa9c7c199`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:16.160793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-830c2e4f-142c-4a6b-bd0b-29315c022c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:16.234323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 699/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Wed May 11 05:50:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:50:16.243359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385a111-c9a0-4338-87a5-cee395804c80 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:16.255041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385a111-c9a0-4338-87a5-cee395804c80 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:16.259982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:16.260631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:16.260922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:16.261205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:16.270855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:16.272320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f307b-5df4-4ee9-afdd-e04ac9a08d8e service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:16.283081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 677/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:17.763274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506684b0-e1e5-4ddb-b5df-07c0a555b470 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:17.763871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506684b0-e1e5-4ddb-b5df-07c0a555b470 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:17.763871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506684b0-e1e5-4ddb-b5df-07c0a555b470 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:17.765231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 700/1377] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:17.771452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6a8e-9ab5-4f91-b919-da613d449869 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:17.772016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6a8e-9ab5-4f91-b919-da613d449869 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:17.772016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6a8e-9ab5-4f91-b919-da613d449869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:17.791369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9aba6a8e-9ab5-4f91-b919-da613d449869 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:17.792603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9aba6a8e-9ab5-4f91-b919-da613d449869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:17.800699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 678/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:17.846485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506684b0-e1e5-4ddb-b5df-07c0a555b470 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:17.861655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506684b0-e1e5-4ddb-b5df-07c0a555b470 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:17.867934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:17.868605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:17.868886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:17.869164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:17.878166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:17.879796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82ee2e-9bfc-4555-9bbd-d3a5a8e84d04 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:17.890967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 701/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:20.189738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185731-5946-48bd-a8fa-f721ed5eeb6e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:20.190203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185731-5946-48bd-a8fa-f721ed5eeb6e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:20.190313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185731-5946-48bd-a8fa-f721ed5eeb6e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:20.191849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 679/1380] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:20.197438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9bdb2-01de-4bf1-ad95-8b0af6d427d6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:20.197859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9bdb2-01de-4bf1-ad95-8b0af6d427d6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:20.198045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9bdb2-01de-4bf1-ad95-8b0af6d427d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:20.216660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b4b9bdb2-01de-4bf1-ad95-8b0af6d427d6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:20.218021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b4b9bdb2-01de-4bf1-ad95-8b0af6d427d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:20.227088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 702/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:20.271295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185731-5946-48bd-a8fa-f721ed5eeb6e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:20.286010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185731-5946-48bd-a8fa-f721ed5eeb6e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:20.292315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:20.293066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:20.293450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:20.293854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:20.302062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:20.303789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6961848-a976-493d-a21a-36a7e774299f service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:20.314273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 680/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:22.580146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbb9d-69ec-4e98-a041-efebe178c4d3 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:22.581186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbb9d-69ec-4e98-a041-efebe178c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:22.581807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbb9d-69ec-4e98-a041-efebe178c4d3 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:22.583956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 703/1383] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:22.588768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d65cb4-8477-413c-8b6a-f5bd3e2db4d5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:22.589226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d65cb4-8477-413c-8b6a-f5bd3e2db4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:22.589317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d65cb4-8477-413c-8b6a-f5bd3e2db4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:22.607211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b2d65cb4-8477-413c-8b6a-f5bd3e2db4d5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:22.608386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2d65cb4-8477-413c-8b6a-f5bd3e2db4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:22.616064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 681/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:22.658756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fbb9d-69ec-4e98-a041-efebe178c4d3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:22.677900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fbb9d-69ec-4e98-a041-efebe178c4d3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:22.685418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:22.686642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:22.687380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:22.687766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:22.698507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:22.700509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65831ad-672c-4e85-aa1a-e9b23c2f28e0 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:22.713819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 704/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:25.108786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647208f-311c-4c7f-95a2-b9e3cb1c552d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:25.109356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647208f-311c-4c7f-95a2-b9e3cb1c552d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:25.109659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647208f-311c-4c7f-95a2-b9e3cb1c552d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:25.112073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 682/1386] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:25.120908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a352-593b-4482-a2b3-aa91cda04891 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:25.121434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a352-593b-4482-a2b3-aa91cda04891 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:25.121434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a352-593b-4482-a2b3-aa91cda04891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:25.140156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4de8a352-593b-4482-a2b3-aa91cda04891 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:25.141375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4de8a352-593b-4482-a2b3-aa91cda04891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:25.149084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 705/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:50:25.195951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647208f-311c-4c7f-95a2-b9e3cb1c552d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:25.210386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647208f-311c-4c7f-95a2-b9e3cb1c552d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:25.215846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:25.216483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:25.216767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:25.217043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:25.225062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:25.226811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e4f9-ab13-4bdb-8853-d1d181148e41 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:25.236180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 683/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:27.519521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984fb7d-c2eb-4307-933e-d12b384385a6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:27.520208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984fb7d-c2eb-4307-933e-d12b384385a6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:27.520208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984fb7d-c2eb-4307-933e-d12b384385a6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:27.521621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 706/1389] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:27.527145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b4ef-b891-4dcd-9be7-89b2f7bb5881 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:27.527727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b4ef-b891-4dcd-9be7-89b2f7bb5881 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:27.527727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b4ef-b891-4dcd-9be7-89b2f7bb5881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:27.546396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7807b4ef-b891-4dcd-9be7-89b2f7bb5881 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:27.547585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7807b4ef-b891-4dcd-9be7-89b2f7bb5881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:27.557233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 684/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:50:27.603153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984fb7d-c2eb-4307-933e-d12b384385a6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:27.617790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984fb7d-c2eb-4307-933e-d12b384385a6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:27.623494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:27.624136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:27.624424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:27.624704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:27.633330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:27.634973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea06798-8255-4a63-953b-cf9f644cafbd service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:27.644429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 707/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:29.942386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f0d09-b300-48ea-827b-aed0b06534c5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:29.942947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f0d09-b300-48ea-827b-aed0b06534c5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:29.942947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f0d09-b300-48ea-827b-aed0b06534c5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:29.944817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 685/1392] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:29.950896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78599fb-391e-4a95-add1-78d50af94577 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:29.951372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78599fb-391e-4a95-add1-78d50af94577 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:29.951601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78599fb-391e-4a95-add1-78d50af94577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:29.971086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e78599fb-391e-4a95-add1-78d50af94577 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:29.972266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e78599fb-391e-4a95-add1-78d50af94577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:29.980099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 708/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:30.024431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f0d09-b300-48ea-827b-aed0b06534c5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:30.039212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f0d09-b300-48ea-827b-aed0b06534c5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:30.044912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:30.045606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:30.045900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:30.046190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:30.055296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:30.056895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547a25-d8ad-4743-9c87-b4b0c364abba service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:30.066490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 686/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:31.910674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1958-3137-4d5f-b0d1-fd7ccae00450 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:31.911285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1958-3137-4d5f-b0d1-fd7ccae00450 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:31.911285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1958-3137-4d5f-b0d1-fd7ccae00450 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:31.912522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 709/1395] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:31.917796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dee0b7-eda6-4714-ad20-d94bcb56c8e3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:31.918210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dee0b7-eda6-4714-ad20-d94bcb56c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:31.918361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dee0b7-eda6-4714-ad20-d94bcb56c8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:31.937305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b3dee0b7-eda6-4714-ad20-d94bcb56c8e3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:31.938528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b3dee0b7-eda6-4714-ad20-d94bcb56c8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:31.947072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 687/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:32.007494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b57a2-581b-4bbe-8616-b6b97831c809 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.007782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b57a2-581b-4bbe-8616-b6b97831c809 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.008238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b57a2-581b-4bbe-8616-b6b97831c809 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.009636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 710/1397] 10.222.0.44 () {54 vars in 962 bytes} [Wed May 11 05:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:32.014906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24641-4c16-4974-812b-87d514770f94 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.015197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24641-4c16-4974-812b-87d514770f94 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.015479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24641-4c16-4974-812b-87d514770f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.063022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a3a24641-4c16-4974-812b-87d514770f94 None None] MFA Rules not processed for user `1d7880dd036c4d1a86a80a3f0a1e6bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:32.064209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a3a24641-4c16-4974-812b-87d514770f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:32.122946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 688/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Wed May 11 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:32.130550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b57a2-581b-4bbe-8616-b6b97831c809 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:32.141870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b57a2-581b-4bbe-8616-b6b97831c809 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:32.145427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:32.146116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.146396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.146669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.156799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:32.158292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9129d-79ba-420d-b975-f9d31bc439e5 service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:32.168514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 711/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:32.311629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40057d9-9649-45bd-8e2b-fbec94296ec3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.311956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40057d9-9649-45bd-8e2b-fbec94296ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.312273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40057d9-9649-45bd-8e2b-fbec94296ec3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.313900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 689/1400] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:32.319166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279b0be-e59c-4b40-b591-db454af456e6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.319499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279b0be-e59c-4b40-b591-db454af456e6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.319776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279b0be-e59c-4b40-b591-db454af456e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.336825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6279b0be-e59c-4b40-b591-db454af456e6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:32.338046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6279b0be-e59c-4b40-b591-db454af456e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:32.345750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 712/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:50:32.394537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40057d9-9649-45bd-8e2b-fbec94296ec3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:32.409192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40057d9-9649-45bd-8e2b-fbec94296ec3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:32.415330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:32.415971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.416259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.416540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.425212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:32.426766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387818-97ab-436b-ba65-909a47bea631 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:32.438494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 690/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:32.616408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a20f-634d-41fd-ac37-9c83e3a7efdc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.616696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a20f-634d-41fd-ac37-9c83e3a7efdc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.616979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a20f-634d-41fd-ac37-9c83e3a7efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.669845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f456a20f-634d-41fd-ac37-9c83e3a7efdc None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:32.671091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f456a20f-634d-41fd-ac37-9c83e3a7efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:32.735377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 713/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:32.781158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd99d-d447-4a97-b661-008a7c9bbf88 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.781518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd99d-d447-4a97-b661-008a7c9bbf88 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.781803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd99d-d447-4a97-b661-008a7c9bbf88 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.783177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 691/1404] 10.222.0.44 () {54 vars in 942 bytes} [Wed May 11 05:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:32.790025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3453-4e6f-40e6-92e0-8467d3a66860 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.790325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3453-4e6f-40e6-92e0-8467d3a66860 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.790592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3453-4e6f-40e6-92e0-8467d3a66860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.837847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-017f3453-4e6f-40e6-92e0-8467d3a66860 None None] MFA Rules not processed for user `c8fda86f5de6480f98993a7a5888112a`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:32.839034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-017f3453-4e6f-40e6-92e0-8467d3a66860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:32.908015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 714/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Wed May 11 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:50:32.917329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd99d-d447-4a97-b661-008a7c9bbf88 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:32.931085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd99d-d447-4a97-b661-008a7c9bbf88 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:32.936229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:32.937501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:32.937927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:32.938276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:32.947316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:32.948877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148a2ae-e30d-4426-a292-1c4342c3a608 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:32.957758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 692/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 05:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 05:50:34.725360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a910c-a8ee-448d-abc9-500110aa86d9 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:34.725957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a910c-a8ee-448d-abc9-500110aa86d9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:34.726089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a910c-a8ee-448d-abc9-500110aa86d9 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:34.727399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 715/1407] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:34.747170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8085-ab3b-45a9-8bc9-99eff7fd495e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:34.748360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8085-ab3b-45a9-8bc9-99eff7fd495e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:34.752083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8085-ab3b-45a9-8bc9-99eff7fd495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:34.779577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0cff8085-ab3b-45a9-8bc9-99eff7fd495e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:34.785252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0cff8085-ab3b-45a9-8bc9-99eff7fd495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:34.797286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 693/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:34.854869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a910c-a8ee-448d-abc9-500110aa86d9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:34.881915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a910c-a8ee-448d-abc9-500110aa86d9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:34.891221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:34.891990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:34.892366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:34.892701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:34.902804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:34.904410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b82369-fe5f-4c3b-9cf5-0b9501449978 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:34.915063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 716/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:50:56.476761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833345-77d0-403e-8134-b32b488baa61 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:56.477397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833345-77d0-403e-8134-b32b488baa61 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:56.477397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833345-77d0-403e-8134-b32b488baa61 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:56.478638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 694/1410] 10.222.0.44 () {54 vars in 918 bytes} [Wed May 11 05:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:56.483910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714fe5-df54-4e1a-91d2-944ca6619a24 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:56.484392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714fe5-df54-4e1a-91d2-944ca6619a24 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:56.484496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714fe5-df54-4e1a-91d2-944ca6619a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:56.502258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-49714fe5-df54-4e1a-91d2-944ca6619a24 None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:56.503435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49714fe5-df54-4e1a-91d2-944ca6619a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:56.512361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 717/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 11 05:50:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:56.526790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647ebbc-1ffc-4dce-9b02-b93adfa7d0e7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:56.527082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647ebbc-1ffc-4dce-9b02-b93adfa7d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:56.527386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647ebbc-1ffc-4dce-9b02-b93adfa7d0e7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:56.528768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 695/1412] 10.222.0.44 () {54 vars in 918 bytes} [Wed May 11 05:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:56.533102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee2b28-3b64-4b29-abae-372277e165e9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:56.533391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee2b28-3b64-4b29-abae-372277e165e9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:56.533724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee2b28-3b64-4b29-abae-372277e165e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:56.551095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e2ee2b28-3b64-4b29-abae-372277e165e9 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:56.552266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e2ee2b28-3b64-4b29-abae-372277e165e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:56.561852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 718/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 11 05:50:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:59.329682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9beb-46ad-46e7-a0a2-dc47be24c928 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:59.330244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9beb-46ad-46e7-a0a2-dc47be24c928 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:59.330244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9beb-46ad-46e7-a0a2-dc47be24c928 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:59.331625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:50:59.337819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b5-8e7c-4da1-bdd2-e7dd6481f485 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:59.338222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b5-8e7c-4da1-bdd2-e7dd6481f485 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:59.338367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b5-8e7c-4da1-bdd2-e7dd6481f485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:59.355625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0b2f12b5-8e7c-4da1-bdd2-e7dd6481f485 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:50:59.356786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b2f12b5-8e7c-4da1-bdd2-e7dd6481f485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:50:59.364413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:50:59.406215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a9beb-46ad-46e7-a0a2-dc47be24c928 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:50:59.420026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a9beb-46ad-46e7-a0a2-dc47be24c928 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:50:59.425261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:50:59.425920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:50:59.426232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:50:59.426507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:50:59.434731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:50:59.436241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f404f-c8d7-424a-8e44-7e10499444da service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:50:59.446086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 697/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:00.442980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d686-5bfa-4644-9a8f-3e7c30e28a58 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:00.443523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d686-5bfa-4644-9a8f-3e7c30e28a58 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:00.443523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d686-5bfa-4644-9a8f-3e7c30e28a58 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:00.445586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:00.450535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7c30-0e6f-46b1-8736-ca845b0497ce None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:00.450959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7c30-0e6f-46b1-8736-ca845b0497ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:00.451127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7c30-0e6f-46b1-8736-ca845b0497ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:00.468500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-34be7c30-0e6f-46b1-8736-ca845b0497ce None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:00.469719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-34be7c30-0e6f-46b1-8736-ca845b0497ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:00.477373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:00.641018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7d686-5bfa-4644-9a8f-3e7c30e28a58 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:00.655182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7d686-5bfa-4644-9a8f-3e7c30e28a58 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:00.660387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:00.661016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:00.661302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:00.661608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:00.670207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:00.671785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aba63-620c-4ab1-b5fe-2b3e80fe64ae service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:00.681643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 721/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:01.614530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fc1a-8a60-4cec-b38c-f597f78862d6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:01.615020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fc1a-8a60-4cec-b38c-f597f78862d6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:01.615128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fc1a-8a60-4cec-b38c-f597f78862d6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:01.617111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:01.621919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11932c4-2411-41b8-980b-e51bea8b3471 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:01.622349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11932c4-2411-41b8-980b-e51bea8b3471 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:01.622539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11932c4-2411-41b8-980b-e51bea8b3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:01.640015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f11932c4-2411-41b8-980b-e51bea8b3471 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:01.641195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f11932c4-2411-41b8-980b-e51bea8b3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:01.648872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:01.796411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fc1a-8a60-4cec-b38c-f597f78862d6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:01.810217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fc1a-8a60-4cec-b38c-f597f78862d6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:01.815411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:01.816041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:01.816327 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:01.816606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:01.824413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:01.826014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c08e3b-fa22-40c9-aef3-4c68c0b1637e service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:01.835703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 700/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:02.756824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb2ac-a906-4e0a-8555-b83c6117e7f7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:02.757408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb2ac-a906-4e0a-8555-b83c6117e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:02.757408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb2ac-a906-4e0a-8555-b83c6117e7f7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:02.758820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:02.764137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb15b-9867-4f24-9a5c-28b17058f3b0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:02.764565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb15b-9867-4f24-9a5c-28b17058f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:02.764706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb15b-9867-4f24-9a5c-28b17058f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:02.782660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-452cb15b-9867-4f24-9a5c-28b17058f3b0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:02.783849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-452cb15b-9867-4f24-9a5c-28b17058f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:02.792239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:02.941493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccb2ac-a906-4e0a-8555-b83c6117e7f7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:02.956355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccb2ac-a906-4e0a-8555-b83c6117e7f7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:02.961838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:02.962467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:02.962751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:02.963027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:02.970871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:02.972434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c493dc1-7f79-4acd-afaf-5955e82579a3 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:02.981944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 724/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:03.905851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07292f9-34cc-4a1c-93f7-4bde41fbb4cf None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:03.906390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07292f9-34cc-4a1c-93f7-4bde41fbb4cf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:03.906390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07292f9-34cc-4a1c-93f7-4bde41fbb4cf None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:03.907718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:03.913241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d977-431d-45ae-a690-e533a21beda4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:03.913691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d977-431d-45ae-a690-e533a21beda4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:03.913824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d977-431d-45ae-a690-e533a21beda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:03.933358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6619d977-431d-45ae-a690-e533a21beda4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:03.934614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6619d977-431d-45ae-a690-e533a21beda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:03.942389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:04.093418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07292f9-34cc-4a1c-93f7-4bde41fbb4cf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:04.107991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07292f9-34cc-4a1c-93f7-4bde41fbb4cf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:04.113535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:04.114162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:04.114444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:04.114718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:04.122769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:04.124334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47420f0-f14d-4b72-88d6-ab5f723b86c4 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:04.133774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 703/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:05.005911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982768-42a5-4cde-a570-72f782056c67 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:05.007219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982768-42a5-4cde-a570-72f782056c67 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:05.007219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982768-42a5-4cde-a570-72f782056c67 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:05.008535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:05.014514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3023-54b5-4967-a612-ae6f9ded3502 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:05.014954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3023-54b5-4967-a612-ae6f9ded3502 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:05.015061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3023-54b5-4967-a612-ae6f9ded3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:05.032570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-186c3023-54b5-4967-a612-ae6f9ded3502 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:05.033837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-186c3023-54b5-4967-a612-ae6f9ded3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:05.041357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:05.189615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d982768-42a5-4cde-a570-72f782056c67 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:05.203842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d982768-42a5-4cde-a570-72f782056c67 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:05.209197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:05.209876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:05.210166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:05.210450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:05.218308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:05.219897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073af95c-f2b5-4116-b65f-d17c6cd6a15e service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:05.229615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 727/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:06.095654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884f25-c1a3-4331-875a-3752cba4cad4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:06.096197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884f25-c1a3-4331-875a-3752cba4cad4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:06.096197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77884f25-c1a3-4331-875a-3752cba4cad4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:06.097613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:06.103120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49293ce9-8112-4e8a-af11-9e713682dd42 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:06.103526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49293ce9-8112-4e8a-af11-9e713682dd42 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:06.103677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49293ce9-8112-4e8a-af11-9e713682dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:06.122339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-49293ce9-8112-4e8a-af11-9e713682dd42 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:06.123509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49293ce9-8112-4e8a-af11-9e713682dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:06.131169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:06.281283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77884f25-c1a3-4331-875a-3752cba4cad4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:06.295878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77884f25-c1a3-4331-875a-3752cba4cad4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:06.301187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:06.301857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:06.302150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:06.302435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:06.310399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:06.311992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff121696-9443-4c5f-bd0e-4584d64c20c8 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:06.321195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 706/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:07.184018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3b211-8e7e-403a-8de6-4fabea93408f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:07.184888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3b211-8e7e-403a-8de6-4fabea93408f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:07.185622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3b211-8e7e-403a-8de6-4fabea93408f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:07.186621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:07.191600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49aed2-2127-4087-9878-3d7309ab615b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:07.192003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49aed2-2127-4087-9878-3d7309ab615b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:07.192157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49aed2-2127-4087-9878-3d7309ab615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:07.210232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7a49aed2-2127-4087-9878-3d7309ab615b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:07.211401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7a49aed2-2127-4087-9878-3d7309ab615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:07.219010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:07.368640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3b211-8e7e-403a-8de6-4fabea93408f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:07.383213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3b211-8e7e-403a-8de6-4fabea93408f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:07.388776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:07.389408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:07.389724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:07.390004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:07.398369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:07.399952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a2a93-f3d0-4036-90a5-b9e9efa2590f service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:07.408963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 730/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:08.283284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047532-bbfb-40d4-9fec-b856866deefa None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:08.283849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047532-bbfb-40d4-9fec-b856866deefa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:08.283849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047532-bbfb-40d4-9fec-b856866deefa None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:08.285308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:08.290481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703978-d79f-40b1-9744-ef47f65158d8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:08.290905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703978-d79f-40b1-9744-ef47f65158d8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:08.291163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703978-d79f-40b1-9744-ef47f65158d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:08.308867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-17703978-d79f-40b1-9744-ef47f65158d8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:08.310108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-17703978-d79f-40b1-9744-ef47f65158d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:08.317911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:08.480506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047532-bbfb-40d4-9fec-b856866deefa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:08.495009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047532-bbfb-40d4-9fec-b856866deefa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:08.500256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:08.500889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:08.501177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:08.501455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:08.510013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:08.511587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b83ad-bbd6-4a0b-9ce5-eb58d084b046 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:08.520893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 709/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:10.602835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607b22-faaf-4d04-ab22-ef8fc88d1bdf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:10.603403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607b22-faaf-4d04-ab22-ef8fc88d1bdf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:10.603403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607b22-faaf-4d04-ab22-ef8fc88d1bdf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:10.604829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:10.610162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36a33-c298-4314-a1bb-849f5131637e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:10.610557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36a33-c298-4314-a1bb-849f5131637e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:10.610730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36a33-c298-4314-a1bb-849f5131637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:10.627833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8ac36a33-c298-4314-a1bb-849f5131637e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:10.629019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8ac36a33-c298-4314-a1bb-849f5131637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:10.637267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:10.675332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607b22-faaf-4d04-ab22-ef8fc88d1bdf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:10.686637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607b22-faaf-4d04-ab22-ef8fc88d1bdf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:10.690253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:10.690908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:10.691262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:10.691569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:10.702043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:10.703473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3676b6-85a3-46ed-bd48-a37bfd9b310d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:10.713252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 733/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:13.054759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9856-b127-40a3-8f85-542a2f08310d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:13.055432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9856-b127-40a3-8f85-542a2f08310d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:13.055432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9856-b127-40a3-8f85-542a2f08310d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:13.056728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:13.062094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386804-c29a-4cca-bda7-e2443f97063c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:13.062502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386804-c29a-4cca-bda7-e2443f97063c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:13.062646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386804-c29a-4cca-bda7-e2443f97063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:13.080867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-23386804-c29a-4cca-bda7-e2443f97063c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:13.082086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-23386804-c29a-4cca-bda7-e2443f97063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:13.091034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:13.129103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9856-b127-40a3-8f85-542a2f08310d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:13.140131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9856-b127-40a3-8f85-542a2f08310d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:13.143652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:13.144312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:13.144598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:13.144875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:13.154067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:13.155487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ed24-3215-4b49-a337-5752de8bf971 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:13.165266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 712/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:15.676012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ec11-6307-4d19-b5c1-3bc5db27df27 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:15.676575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ec11-6307-4d19-b5c1-3bc5db27df27 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:15.676575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ec11-6307-4d19-b5c1-3bc5db27df27 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:15.678090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:15.683392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2818-f668-4411-a30d-9178b630e240 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:15.683842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2818-f668-4411-a30d-9178b630e240 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:15.683940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2818-f668-4411-a30d-9178b630e240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:15.701841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c96a2818-f668-4411-a30d-9178b630e240 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:15.703033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c96a2818-f668-4411-a30d-9178b630e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:15.711233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:15.747903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2ec11-6307-4d19-b5c1-3bc5db27df27 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:15.758793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2ec11-6307-4d19-b5c1-3bc5db27df27 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:15.762225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:15.763090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:15.763380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:15.763654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:15.772637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:15.774097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c57dc8-db45-467a-a844-1e8375cf3aff service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:15.782973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 736/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:18.097353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d51ac-c2c6-4240-b414-83a16eff9dbe None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:18.097989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d51ac-c2c6-4240-b414-83a16eff9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:18.097989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d51ac-c2c6-4240-b414-83a16eff9dbe None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:18.099333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:18.104983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f49b-233f-4f49-9367-bb7644597aee None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:18.105417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f49b-233f-4f49-9367-bb7644597aee None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:18.105580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f49b-233f-4f49-9367-bb7644597aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:18.122898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-17a8f49b-233f-4f49-9367-bb7644597aee None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:18.124081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-17a8f49b-233f-4f49-9367-bb7644597aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:18.132594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:18.171191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d51ac-c2c6-4240-b414-83a16eff9dbe None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:18.182035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d51ac-c2c6-4240-b414-83a16eff9dbe None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:18.185683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:18.186321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:18.186613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:18.186895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:18.196317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:18.197780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d691a9-5051-4490-93e6-f8882eae1035 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:18.206910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 715/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:20.528098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810eb2-2b8b-4c67-a34a-9ae1e9d6c85e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:20.528670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810eb2-2b8b-4c67-a34a-9ae1e9d6c85e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:20.528670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810eb2-2b8b-4c67-a34a-9ae1e9d6c85e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:20.530058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:20.535305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c14c0-6911-458f-8a34-a9b306c195b7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:20.535702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c14c0-6911-458f-8a34-a9b306c195b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:20.535904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c14c0-6911-458f-8a34-a9b306c195b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:20.554413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-175c14c0-6911-458f-8a34-a9b306c195b7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:20.555592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-175c14c0-6911-458f-8a34-a9b306c195b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:20.563294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:20.600494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810eb2-2b8b-4c67-a34a-9ae1e9d6c85e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:20.610952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810eb2-2b8b-4c67-a34a-9ae1e9d6c85e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:20.614468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:20.615099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:20.615931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:20.616212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:20.624806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:20.626270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb9f1-cf47-4ffa-90e7-6d3e707138e3 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:20.636242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 739/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:22.955037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796642b-f382-4fc1-ad2d-e77bf31a25b8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:22.955618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796642b-f382-4fc1-ad2d-e77bf31a25b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:22.955618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796642b-f382-4fc1-ad2d-e77bf31a25b8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:22.956957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:22.962949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96867e-cf53-4188-922f-43656b2f1994 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:22.963354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96867e-cf53-4188-922f-43656b2f1994 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:22.963505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96867e-cf53-4188-922f-43656b2f1994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:22.981754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6f96867e-cf53-4188-922f-43656b2f1994 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:22.982954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6f96867e-cf53-4188-922f-43656b2f1994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:22.990747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:23.028772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796642b-f382-4fc1-ad2d-e77bf31a25b8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:23.040551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796642b-f382-4fc1-ad2d-e77bf31a25b8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:23.044076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:23.044709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:23.045001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:23.045308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:23.054139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:23.055571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc5ce-333c-441f-86e5-4bce02aa44c9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:23.064683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 718/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:25.359072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31473d1-325a-4aa6-9c28-ff118abbab2b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:25.359667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31473d1-325a-4aa6-9c28-ff118abbab2b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:25.359781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31473d1-325a-4aa6-9c28-ff118abbab2b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:25.361129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:25.367194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c454e7-2f93-4dac-a278-4414a5d89d0c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:25.367606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c454e7-2f93-4dac-a278-4414a5d89d0c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:25.367764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c454e7-2f93-4dac-a278-4414a5d89d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:25.386020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-82c454e7-2f93-4dac-a278-4414a5d89d0c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:25.387228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-82c454e7-2f93-4dac-a278-4414a5d89d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:25.395378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:51:25.433398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31473d1-325a-4aa6-9c28-ff118abbab2b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:25.443756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31473d1-325a-4aa6-9c28-ff118abbab2b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:25.447130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:25.447754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:25.448035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:25.448312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:25.456813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:25.458276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e786d4b-bac0-4335-93d8-c56671ae5fd2 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:25.467304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 742/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:27.708525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3556-f20a-4f40-b08d-0754a43a8853 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:27.709099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3556-f20a-4f40-b08d-0754a43a8853 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:27.709099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3556-f20a-4f40-b08d-0754a43a8853 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:27.710524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:27.715865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916a73-91c2-4844-a451-8ad6648dafc5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:27.716318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916a73-91c2-4844-a451-8ad6648dafc5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:27.716423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916a73-91c2-4844-a451-8ad6648dafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:27.734274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e8916a73-91c2-4844-a451-8ad6648dafc5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:27.735451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e8916a73-91c2-4844-a451-8ad6648dafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:27.743690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:27.780452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c3556-f20a-4f40-b08d-0754a43a8853 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:27.791617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c3556-f20a-4f40-b08d-0754a43a8853 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:27.795110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:27.795738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:27.796022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:27.796299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:27.805549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:27.806967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f902fb-421b-4d41-8625-51880e6a95a1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:27.815926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 721/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:30.035028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed33a-07d7-4253-a916-aa800fec47d1 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:30.035570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed33a-07d7-4253-a916-aa800fec47d1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:30.035570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed33a-07d7-4253-a916-aa800fec47d1 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:30.037647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:30.042934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999312d3-d351-451a-93cb-6dc777e8c168 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:30.043329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999312d3-d351-451a-93cb-6dc777e8c168 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:30.043495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999312d3-d351-451a-93cb-6dc777e8c168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:30.061264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-999312d3-d351-451a-93cb-6dc777e8c168 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:30.062478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-999312d3-d351-451a-93cb-6dc777e8c168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:30.070369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:30.105949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eed33a-07d7-4253-a916-aa800fec47d1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:30.116850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eed33a-07d7-4253-a916-aa800fec47d1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:30.120577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:30.121210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:30.121515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:30.121795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:30.130592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:30.132005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca2983-2eaf-475c-9450-69d1cbecd263 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:30.141388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 745/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:51:32.348384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da5c13-2be1-4d95-8669-bee38d18e0b6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:32.348918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da5c13-2be1-4d95-8669-bee38d18e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:32.348918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da5c13-2be1-4d95-8669-bee38d18e0b6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:32.351053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:51:32.356379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea312c-8c93-4e5c-9630-f8ec10aa1e60 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:32.356822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea312c-8c93-4e5c-9630-f8ec10aa1e60 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:32.356920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea312c-8c93-4e5c-9630-f8ec10aa1e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:32.375832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1fea312c-8c93-4e5c-9630-f8ec10aa1e60 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:51:32.377933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1fea312c-8c93-4e5c-9630-f8ec10aa1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:51:32.389197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:51:32.425594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da5c13-2be1-4d95-8669-bee38d18e0b6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:51:32.436512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da5c13-2be1-4d95-8669-bee38d18e0b6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:51:32.439879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:51:32.440507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:51:32.440789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:51:32.441074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:51:32.449887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:51:32.451295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae9e0a-f8f8-4175-b2d1-c930a80afbf8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:51:32.460889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 724/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:05.556370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac39f0-b276-4b30-b72d-f6d1cf50e229 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:05.556967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac39f0-b276-4b30-b72d-f6d1cf50e229 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:05.556967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac39f0-b276-4b30-b72d-f6d1cf50e229 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:05.558332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 747/1471] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:05.563360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44813d-364b-42e4-b5c5-2375f09999d5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:05.563822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44813d-364b-42e4-b5c5-2375f09999d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:05.564002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44813d-364b-42e4-b5c5-2375f09999d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:05.582483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1c44813d-364b-42e4-b5c5-2375f09999d5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:05.583785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c44813d-364b-42e4-b5c5-2375f09999d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:05.591520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 725/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:05.638452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bca9c-397b-4e30-9ed0-548825201a37 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:05.639019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bca9c-397b-4e30-9ed0-548825201a37 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:05.639316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bca9c-397b-4e30-9ed0-548825201a37 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:05.640680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 748/1473] 10.222.0.44 () {54 vars in 962 bytes} [Wed May 11 05:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:05.647395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f4e7-4d20-4a0a-9811-73cd83b30552 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:05.647715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f4e7-4d20-4a0a-9811-73cd83b30552 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:05.647999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f4e7-4d20-4a0a-9811-73cd83b30552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:05.665650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3237f4e7-4d20-4a0a-9811-73cd83b30552 None None] MFA Rules not processed for user `1d7880dd036c4d1a86a80a3f0a1e6bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:05.666826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3237f4e7-4d20-4a0a-9811-73cd83b30552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:05.673062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 726/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Wed May 11 05:52:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:05.680612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bca9c-397b-4e30-9ed0-548825201a37 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:05.690912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bca9c-397b-4e30-9ed0-548825201a37 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:05.695073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:05.695699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:05.695984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:05.696266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:05.704819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:05.706293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93061a-8743-4973-bdef-863781d1f38d service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:05.715388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 749/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:07.996181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0bb0-a8d5-444f-925e-332b7aeca877 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:07.996706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0bb0-a8d5-444f-925e-332b7aeca877 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:07.996804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0bb0-a8d5-444f-925e-332b7aeca877 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:07.998189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 727/1476] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:08.003453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961761-f382-4358-8c09-05d642891d94 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:08.003882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961761-f382-4358-8c09-05d642891d94 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:08.004043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961761-f382-4358-8c09-05d642891d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:08.022091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c7961761-f382-4358-8c09-05d642891d94 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:08.023265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c7961761-f382-4358-8c09-05d642891d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:08.030833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 750/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:08.053712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0bb0-a8d5-444f-925e-332b7aeca877 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:08.065837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0bb0-a8d5-444f-925e-332b7aeca877 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:08.071367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:08.072019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:08.072306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:08.072580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:08.073314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:08.075216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:52:08.075216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:52:08.075216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:52:08.076365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75994e-0d9b-4354-be99-b43afe460a5a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:08.095587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 728/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 11 05:52:08 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:52:10.318914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cc01-8cef-4541-a1a6-b5cbece32540 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:10.319419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cc01-8cef-4541-a1a6-b5cbece32540 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:10.319538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cc01-8cef-4541-a1a6-b5cbece32540 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:10.320826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 751/1479] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:10.325990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f199-6a51-4213-a968-e66d5ab312ca None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:10.326390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f199-6a51-4213-a968-e66d5ab312ca None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:10.326554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f199-6a51-4213-a968-e66d5ab312ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:10.344070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8373f199-6a51-4213-a968-e66d5ab312ca None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:10.345592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8373f199-6a51-4213-a968-e66d5ab312ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:10.353998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 729/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:10.396509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cc01-8cef-4541-a1a6-b5cbece32540 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:10.410300 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cc01-8cef-4541-a1a6-b5cbece32540 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:10.416206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:10.416832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:10.417115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:10.417391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:10.425091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:10.427295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2e072-ddb0-4c63-93df-b8a68e5eb4d9 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:10.436286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 752/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:12.839901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9caf5-54f1-4f4e-8850-594dc7518a15 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:12.840559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9caf5-54f1-4f4e-8850-594dc7518a15 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:12.840559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9caf5-54f1-4f4e-8850-594dc7518a15 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:12.841871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 730/1482] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:12.847095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f032a-9603-4c80-be51-1c831af23fb8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:12.847550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f032a-9603-4c80-be51-1c831af23fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:12.847691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f032a-9603-4c80-be51-1c831af23fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:12.866161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d20f032a-9603-4c80-be51-1c831af23fb8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:12.867345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d20f032a-9603-4c80-be51-1c831af23fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:12.875121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 753/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:12.912213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9caf5-54f1-4f4e-8850-594dc7518a15 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:12.922870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9caf5-54f1-4f4e-8850-594dc7518a15 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:12.926384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:12.927596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:12.927878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:12.928154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:12.936775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:12.938239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff8019-88e1-4816-b515-5c7e4b6d7bad service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:12.947344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 731/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:15.209674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aef9-c018-4bb9-a196-23b6b4f16699 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:15.210126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aef9-c018-4bb9-a196-23b6b4f16699 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:15.210254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3aef9-c018-4bb9-a196-23b6b4f16699 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:15.211598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 754/1485] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:15.216970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc68b8-270f-4120-bfe9-8d562c713b6b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:15.217382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc68b8-270f-4120-bfe9-8d562c713b6b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:15.217560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc68b8-270f-4120-bfe9-8d562c713b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:15.235663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4edc68b8-270f-4120-bfe9-8d562c713b6b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:15.236856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4edc68b8-270f-4120-bfe9-8d562c713b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:15.244882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 732/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:52:15.281932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3aef9-c018-4bb9-a196-23b6b4f16699 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:15.292839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3aef9-c018-4bb9-a196-23b6b4f16699 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:15.296334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:15.296963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:15.297250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:15.297565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:15.306594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:15.308039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3517a-ff7e-4514-816e-dd6bf2030330 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:15.317144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 755/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:17.629021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cfbc-c5bb-4fe9-b893-86796772dfba None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:17.629619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cfbc-c5bb-4fe9-b893-86796772dfba None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:17.629733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cfbc-c5bb-4fe9-b893-86796772dfba None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:17.631164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 733/1488] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:17.636497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a282d-f09c-40f5-81dd-eb60389308d9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:17.636885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a282d-f09c-40f5-81dd-eb60389308d9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:17.637062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a282d-f09c-40f5-81dd-eb60389308d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:17.655121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-841a282d-f09c-40f5-81dd-eb60389308d9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:17.656302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-841a282d-f09c-40f5-81dd-eb60389308d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:17.664642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 756/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:17.703244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cfbc-c5bb-4fe9-b893-86796772dfba None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:17.714125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cfbc-c5bb-4fe9-b893-86796772dfba None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:17.717551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:17.718188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:17.718477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:17.718758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:17.727971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:17.729425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab475-759c-4d81-a3f2-72437986cc26 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:17.740163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 734/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:52:20.120722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67e8a-abb9-4829-9cc8-cab8b25bcbf0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:20.121294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67e8a-abb9-4829-9cc8-cab8b25bcbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:20.121294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67e8a-abb9-4829-9cc8-cab8b25bcbf0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:20.122750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 757/1491] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 11 05:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:52:20.127928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeabac3-491f-45d5-bedf-9683c15162cd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:20.128354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeabac3-491f-45d5-bedf-9683c15162cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:20.128489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeabac3-491f-45d5-bedf-9683c15162cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:20.147232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fdeabac3-491f-45d5-bedf-9683c15162cd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:52:20.148423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fdeabac3-491f-45d5-bedf-9683c15162cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:52:20.156105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 735/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 11 05:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:52:20.194564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67e8a-abb9-4829-9cc8-cab8b25bcbf0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:52:20.204788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67e8a-abb9-4829-9cc8-cab8b25bcbf0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:52:20.208898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:52:20.209557 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:52:20.209848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:52:20.210127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:52:20.218908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:52:20.220373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef3816-061d-48fd-a0ca-45c9b64025de service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:52:20.229672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 758/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:53:54.120353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.120970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.120970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.138423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:53:54.139608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:54.148036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 736/1494] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:53:54.157107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.157625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.157740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.176333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:53:54.177550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:54.185340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 759/1495] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:53:54.190013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.199570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf676-8e3f-4f35-94df-1f0332ae9a5a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.204236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.204889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.205204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.205509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.206766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:53:54.207073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.208098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.208098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:53:54.208098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:53:54.208981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.220264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 737/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:53:54.228813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.237735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ad16-f08c-4052-aa23-1acd61408de4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.242158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.242797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.243080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.243358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.244049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.245828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.245828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:53:54.245828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:53:54.247009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.285414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 760/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:53:54.289665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.299139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c655200-c698-477d-b1c8-92dbe47ad59d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.354946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.355614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.355909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.356190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.356890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.357937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.357937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:53:54.357937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:53:54.359155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.378922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 738/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:53:54.382978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.393091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f390a-125c-480b-9d91-6f34f1e8de57 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.398300 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.398951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.399235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.399510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.400227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.401236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.401236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:53:54.401236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:53:54.402148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.415013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 761/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:53:54.418729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.428414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb313ab6-7180-4131-b3b2-597ad028ac54 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.432912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.433586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.433893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.434172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.434886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.435879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.435879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:53:54.435879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:53:54.436758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9010f3-e8df-4947-80ce-4fe61c24904b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.449658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 739/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:53:54.453547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.463555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d02f4-bb2d-4b8e-bfab-c52025c806a1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.468483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.469366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.469668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.469950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] PATH_INFO: `/v3/projects/de72000fdc2447698fde0917c9ee57f2/users/b8fe2dc2dc944a66b95d5b72be9ba57a/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.484733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=de72000fdc2447698fde0917c9ee57f2, user_id=b8fe2dc2dc944a66b95d5b72be9ba57a, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.485799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.485799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:53:54.485799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:53:54.487732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faf7f7-9c50-4e63-8192-9b295dbb1eed admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.499503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 762/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:53:54 2022] PUT /identity/v3/projects/de72000fdc2447698fde0917c9ee57f2/users/b8fe2dc2dc944a66b95d5b72be9ba57a/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:53:54.510643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4355e4-a18f-4b80-b362-4e377a2895ce None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.510936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4355e4-a18f-4b80-b362-4e377a2895ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.511220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4355e4-a18f-4b80-b362-4e377a2895ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.538724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fb4355e4-a18f-4b80-b362-4e377a2895ce None None] MFA Rules not processed for user `b8fe2dc2dc944a66b95d5b72be9ba57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:53:54.539912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fb4355e4-a18f-4b80-b362-4e377a2895ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:54.727779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 740/1502] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:53:54.741596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7964a-a1b3-4109-be36-9f9ee6f95f56 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.741887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7964a-a1b3-4109-be36-9f9ee6f95f56 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.742166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7964a-a1b3-4109-be36-9f9ee6f95f56 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.743572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 763/1503] 10.222.0.44 () {54 vars in 963 bytes} [Wed May 11 05:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:53:54.748154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce36e40-547d-4d8e-9dca-cc73798b5154 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.748444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce36e40-547d-4d8e-9dca-cc73798b5154 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.748719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce36e40-547d-4d8e-9dca-cc73798b5154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.766594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6ce36e40-547d-4d8e-9dca-cc73798b5154 None None] MFA Rules not processed for user `8a422e2a9c3640e888f2743aa9c7c199`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:53:54.767789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6ce36e40-547d-4d8e-9dca-cc73798b5154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:54.820590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 741/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Wed May 11 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:53:54.827959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7964a-a1b3-4109-be36-9f9ee6f95f56 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.838927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7964a-a1b3-4109-be36-9f9ee6f95f56 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.842437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.843061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.843370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.843643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.852158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.853620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:54.862265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 764/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:53:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:53:54.903816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3382-7397-4a70-8f13-3558d8025459 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.904114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3382-7397-4a70-8f13-3558d8025459 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.904393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3382-7397-4a70-8f13-3558d8025459 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.905724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 742/1506] 10.222.0.44 () {52 vars in 829 bytes} [Wed May 11 05:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:53:54.909608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:54.968782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18fc9-418a-4c1c-a72e-e64a18c7cc40 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:54.973908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:54.974773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:54.975058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:54.975336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] PATH_INFO: `/v3/users/b8fe2dc2dc944a66b95d5b72be9ba57a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:54.976521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fe2dc2dc944a66b95d5b72be9ba57a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:54.977536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:54.977536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:53:54.977536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:53:54.978784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:55.042561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fe2dc2dc944a66b95d5b72be9ba57a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.060435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fe2dc2dc944a66b95d5b72be9ba57a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.061083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fe2dc2dc944a66b95d5b72be9ba57a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.061849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fe2dc2dc944a66b95d5b72be9ba57a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.071054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fe2dc2dc944a66b95d5b72be9ba57a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.088924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 765/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:53:54 2022] DELETE /identity/v3/users/b8fe2dc2dc944a66b95d5b72be9ba57a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:53:55.093527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:55.093824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:55.094135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:55.111689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:53:55.113213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:55.168922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 743/1508] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:53:55.179197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:55.180622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:55.236206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998548-1a74-4923-b4f2-be1ecf2669f0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:55.239889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:55.240529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:55.240820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:55.241098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:55.249709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:55.251142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afea55-9cf7-46aa-b2c3-579738590b45 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:55.260226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 766/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:53:55.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:53:55.685292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:53:55.696808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f381b4-1e4b-44f0-b213-84f58efd53a2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:53:55.702150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:53:55.703000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:53:55.703285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:53:55.703596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] PATH_INFO: `/v3/projects/de72000fdc2447698fde0917c9ee57f2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:53:55.704775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de72000fdc2447698fde0917c9ee57f2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:53:55.706344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:53:55.706344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:53:55.706344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:53:55.707552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:53:55.765790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de72000fdc2447698fde0917c9ee57f2', 'request_id': 'req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.772094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de72000fdc2447698fde0917c9ee57f2', 'request_id': 'req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.785872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de72000fdc2447698fde0917c9ee57f2', 'request_id': 'req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.800008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] The token cache is being invalidate because project de72000fdc2447698fde0917c9ee57f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:53:55.800297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.800923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe9e7f65-ce9a-4c14-8833-4ec8512f8e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:53:55.802572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 744/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:53:55 2022] DELETE /identity/v3/projects/de72000fdc2447698fde0917c9ee57f2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:55:42.716028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:42.716680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:42.716680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:42.718015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:55:42.723455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65143c69-54ac-4027-9a71-7f5f9c5560a6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:42.723910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65143c69-54ac-4027-9a71-7f5f9c5560a6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:42.724018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65143c69-54ac-4027-9a71-7f5f9c5560a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:42.742041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-65143c69-54ac-4027-9a71-7f5f9c5560a6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:42.743226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-65143c69-54ac-4027-9a71-7f5f9c5560a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:42.800561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:42.967732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:55:42.969285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:43.040130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6c213-2427-4933-9814-069d08133f01 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:55:43.045490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:55:43.046137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:43.046422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:43.046700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:43.055021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:55:43.056596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9785b-8f73-43a2-903a-3e02b96881cc service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:55:43.066309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 768/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:55:43.602240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeabbc-7a17-492e-8568-06905c1b6abf None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:43.602567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeabbc-7a17-492e-8568-06905c1b6abf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:43.602849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeabbc-7a17-492e-8568-06905c1b6abf None None] PATH_INFO: `/v3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:43.604197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 746/1514] 10.222.0.24 () {54 vars in 925 bytes} [Wed May 11 05:55:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:55:43.611831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fc5-b7c8-4d76-9e77-d3f7553d89ba None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:43.612124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fc5-b7c8-4d76-9e77-d3f7553d89ba None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:43.612405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fc5-b7c8-4d76-9e77-d3f7553d89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:43.630519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-57b19fc5-b7c8-4d76-9e77-d3f7553d89ba None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:43.631892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-57b19fc5-b7c8-4d76-9e77-d3f7553d89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:43.692675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 769/1515] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 05:55:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:43.962591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e319-32be-48c7-832b-2990623e73ce None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:43.963182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e319-32be-48c7-832b-2990623e73ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:43.963432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e319-32be-48c7-832b-2990623e73ce None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:43.966012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 747/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:55:43.971861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed26f-7b74-41f2-b269-c9b83d2017b4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:43.972324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed26f-7b74-41f2-b269-c9b83d2017b4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:43.972430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed26f-7b74-41f2-b269-c9b83d2017b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:43.992974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f39ed26f-7b74-41f2-b269-c9b83d2017b4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:43.994222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f39ed26f-7b74-41f2-b269-c9b83d2017b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:44.003002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 770/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:44.158380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03e319-32be-48c7-832b-2990623e73ce None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:55:44.172491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03e319-32be-48c7-832b-2990623e73ce None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:55:44.178825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:55:44.179468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:44.179757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:44.180048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:44.188333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:55:44.190143 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee17567-b09e-4dcd-9e0c-c3700920302c service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:55:44.199332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 748/1518] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:55:52.958511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466bf6-b8cd-4f07-b58d-556afba096fc None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:52.959036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466bf6-b8cd-4f07-b58d-556afba096fc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:52.959036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466bf6-b8cd-4f07-b58d-556afba096fc None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:52.960492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 771/1519] 10.222.0.44 () {54 vars in 960 bytes} [Wed May 11 05:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:55:52.965300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e6cf-bb14-4eea-85c7-1de1d843e4b8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:52.965723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e6cf-bb14-4eea-85c7-1de1d843e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:52.965905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e6cf-bb14-4eea-85c7-1de1d843e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:52.984514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2841e6cf-bb14-4eea-85c7-1de1d843e4b8 None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:52.985739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2841e6cf-bb14-4eea-85c7-1de1d843e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:52.994569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 749/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Wed May 11 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:53.002215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3466bf6-b8cd-4f07-b58d-556afba096fc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:55:53.015335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3466bf6-b8cd-4f07-b58d-556afba096fc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:55:53.021076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:55:53.021740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:53.022027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:53.022305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:53.030440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:55:53.032035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858904ac-cb2d-4e90-b34b-0676abeecc56 service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:55:53.041835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 772/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:55:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:55:55.589150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d16c-6af2-4cac-99ff-705862289d06 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:55.589744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d16c-6af2-4cac-99ff-705862289d06 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:55.589744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d16c-6af2-4cac-99ff-705862289d06 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:55.591176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:55:55.596668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca502-62d8-4c33-aaa2-3607afd95061 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:55.597077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca502-62d8-4c33-aaa2-3607afd95061 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:55.597222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca502-62d8-4c33-aaa2-3607afd95061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:55.615162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-154ca502-62d8-4c33-aaa2-3607afd95061 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:55.616348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-154ca502-62d8-4c33-aaa2-3607afd95061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:55.624212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:55.777538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d16c-6af2-4cac-99ff-705862289d06 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:55:55.792296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d16c-6af2-4cac-99ff-705862289d06 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:55:55.797617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:55:55.798252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:55.798563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:55.798838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:55.806782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:55:55.808358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaef226-7bc9-4f8d-b007-077692ad6ba8 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:55:55.817558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 751/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:55:56.708809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da0df-2bd0-44a5-90ae-f6c213df8ddc None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:56.709393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da0df-2bd0-44a5-90ae-f6c213df8ddc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:56.709393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da0df-2bd0-44a5-90ae-f6c213df8ddc None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:56.710754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 05:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:55:56.715499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1feb-7445-487f-b156-9d5c965e8b6b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:56.715944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1feb-7445-487f-b156-9d5c965e8b6b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:56.716052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1feb-7445-487f-b156-9d5c965e8b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:56.734109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7ecb1feb-7445-487f-b156-9d5c965e8b6b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:55:56.735292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7ecb1feb-7445-487f-b156-9d5c965e8b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:55:56.742897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:55:56.897907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da0df-2bd0-44a5-90ae-f6c213df8ddc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:55:56.911606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da0df-2bd0-44a5-90ae-f6c213df8ddc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:55:56.916816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:55:56.917435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:55:56.917746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:55:56.918019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:55:56.925669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:55:56.927273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437da7-197d-469a-818c-3d2c5d183f9e service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:55:56.936181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 775/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:56:01.030118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:01.030659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:01.030659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:01.032107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:56:01.037911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc6d1-0fab-406b-88ac-6e98a06278cb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:01.038298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc6d1-0fab-406b-88ac-6e98a06278cb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:01.038466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc6d1-0fab-406b-88ac-6e98a06278cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:01.056169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d5efc6d1-0fab-406b-88ac-6e98a06278cb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:56:01.057347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d5efc6d1-0fab-406b-88ac-6e98a06278cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:01.065042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:56:01.101738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:56:01.103439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:01.159835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019eb11-e2cb-4caf-a3dd-816d7ea6cf04 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:56:01.163351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:56:01.163989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:01.164275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:01.164554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:01.173164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:56:01.174640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e67b-f953-402b-ab1e-8b031cfdadf9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:56:01.184913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 754/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:56:03.386363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:03.386916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:03.386916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:03.388288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:56:03.394611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ce4f-09f7-47ac-b4c3-317a863c42c2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:03.395063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ce4f-09f7-47ac-b4c3-317a863c42c2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:03.395170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ce4f-09f7-47ac-b4c3-317a863c42c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:03.413242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cc32ce4f-09f7-47ac-b4c3-317a863c42c2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:56:03.414448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc32ce4f-09f7-47ac-b4c3-317a863c42c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:03.421993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:56:03.459062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:56:03.460719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:03.473803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5164-dc9c-4733-a351-ab6e4c76d1e5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:56:03.477254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:56:03.477913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:03.478202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:03.478480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:03.487454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:56:03.488890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d749e-755e-460b-a44f-c4128f121c59 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:56:03.497948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 778/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:56:07.456727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:07.457258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:07.457258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:07.458619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:56:07.463822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b55c-5d8b-4cfe-aa9b-84196469f32f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:07.464228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b55c-5d8b-4cfe-aa9b-84196469f32f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:07.464409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b55c-5d8b-4cfe-aa9b-84196469f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:07.482596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ebd1b55c-5d8b-4cfe-aa9b-84196469f32f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:56:07.483780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ebd1b55c-5d8b-4cfe-aa9b-84196469f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:07.492386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:56:07.768246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:56:07.769949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:07.825686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffbba-8040-47f6-9d7f-bfabebae9d87 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:56:07.829214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:56:07.830007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:07.830295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:07.830576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:07.839325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:56:07.840788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a647c6-fd95-4c1f-9603-b6827bda2241 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:56:07.850346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 757/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:56:10.132902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:10.133447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:10.133447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:10.134806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 05:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:56:10.140139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abe87-73d0-4f7f-9cbb-bb1581cd3d09 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:10.140825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abe87-73d0-4f7f-9cbb-bb1581cd3d09 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:10.140989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abe87-73d0-4f7f-9cbb-bb1581cd3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:10.159670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d24abe87-73d0-4f7f-9cbb-bb1581cd3d09 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:56:10.160856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d24abe87-73d0-4f7f-9cbb-bb1581cd3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:10.168795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 05:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:56:10.436808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:56:10.438496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:56:10.451131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1b002-14d6-4ed7-92e2-38b2b1cecd58 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:56:10.454600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:56:10.455227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:56:10.455508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:56:10.455785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:56:10.464244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:56:10.465704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed782e2b-8eb7-4b68-b5e3-86b8c2b4026f service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:56:10.475452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 781/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:42.553425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.555130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.555795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.582612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.584240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:42.597776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 759/1540] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:42.608653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dd824-58ae-443f-bc23-c5830540553d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.609729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dd824-58ae-443f-bc23-c5830540553d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.610247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dd824-58ae-443f-bc23-c5830540553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.636332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e00dd824-58ae-443f-bc23-c5830540553d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.638003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e00dd824-58ae-443f-bc23-c5830540553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:42.648094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 782/1541] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:42.653126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:42.672056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591fa6-2bc1-4d56-b349-53206ec4f09d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:42.678576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:42.680249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.680780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.681283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.682300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:42.682837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:42.684700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:42.701713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 760/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:42.711145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a2d4-a3b1-4be5-8f7c-9710df527166 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.711807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a2d4-a3b1-4be5-8f7c-9710df527166 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.712314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a2d4-a3b1-4be5-8f7c-9710df527166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.713596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:42.727321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4bbb-96e8-49df-90ab-84fd0b031d10 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:42.735253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:42.736324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.736980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.737492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.738434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:42.739698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:42.739698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:57:42.739698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:57:42.741319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:42.745245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8933a2d4-a3b1-4be5-8f7c-9710df527166 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.751546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8933a2d4-a3b1-4be5-8f7c-9710df527166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:42.770076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 783/1543] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:57:42.782101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2007da4-bc71-4d3c-953a-d0ce98bb1d0e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.782696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2007da4-bc71-4d3c-953a-d0ce98bb1d0e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.783415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2007da4-bc71-4d3c-953a-d0ce98bb1d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.789690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 761/1544] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:42.793377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:42.811808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e2007da4-bc71-4d3c-953a-d0ce98bb1d0e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.813261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e2007da4-bc71-4d3c-953a-d0ce98bb1d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:42.904259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 784/1545] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:57:42.906132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e3bd-8972-46ac-9a78-cd3ed53ad18a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.906638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e3bd-8972-46ac-9a78-cd3ed53ad18a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.907095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e3bd-8972-46ac-9a78-cd3ed53ad18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.933992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71534d5-528e-4c28-8c20-e73809dbcad6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:42.938060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-04b9e3bd-8972-46ac-9a78-cd3ed53ad18a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.939678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-04b9e3bd-8972-46ac-9a78-cd3ed53ad18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:42.945058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:42.945930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.946957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.947370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.948284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:42.950372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:42.961899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 785/1546] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:42.963409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef7d9-1ec9-4ef0-b3d7-beb667c5499b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:42.963861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef7d9-1ec9-4ef0-b3d7-beb667c5499b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:42.964307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef7d9-1ec9-4ef0-b3d7-beb667c5499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:42.990239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f59ef7d9-1ec9-4ef0-b3d7-beb667c5499b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:42.991708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f59ef7d9-1ec9-4ef0-b3d7-beb667c5499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.000784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 762/1547] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:57:43.002311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.004515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 786/1548] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.010993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.011533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.011972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.023703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dabc3-ad44-46ac-85fa-8ac2d800b83c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.038878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.039830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.040287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.040731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.041644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.045045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.047184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba6f0-dcdd-4b4e-ac28-fc06b7ba1e65 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.050662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.052527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.066413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 763/1549] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.067726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 787/1550] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.068746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.069835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fda48-b2bd-4314-973a-13bdfdd97e16 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.070358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fda48-b2bd-4314-973a-13bdfdd97e16 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.070857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fda48-b2bd-4314-973a-13bdfdd97e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.080760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db9c7c-605d-48f1-ae5a-50ef7070e9e5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.085765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.086444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.086729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.087008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.087740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.089406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9eca7-fe01-4e32-b9c2-02380e3830ab admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.094170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c22fda48-b2bd-4314-973a-13bdfdd97e16 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.095481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c22fda48-b2bd-4314-973a-13bdfdd97e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.103981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 788/1551] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:43.103981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.103981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.103981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.106113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 764/1552] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.107253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251f59-f059-48a0-b715-1f9d5cce9289 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.107549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251f59-f059-48a0-b715-1f9d5cce9289 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.107864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251f59-f059-48a0-b715-1f9d5cce9289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.127593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.127914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-04251f59-f059-48a0-b715-1f9d5cce9289 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.128798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.129083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-04251f59-f059-48a0-b715-1f9d5cce9289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.137015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 765/1553] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.137145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 789/1554] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.137710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.139096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.139449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.139821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.150580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0a59-a309-46b9-a718-8c6224b8c4ec None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.155264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.155948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.156228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.156502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.157269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.157584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.159154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:43.159154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:57:43.159154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:57:43.160026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99291e0c-f1e0-4391-acaf-36920b603537 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.160144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.161321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.169240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 766/1555] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.170168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.180352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 790/1556] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.180352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.180352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.180352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.185431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3414b-5035-4205-8ac6-5ff24c4aab73 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.191126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.191998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.192286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.192564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.193261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.195215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ec93f-61c8-4d30-9a1e-71853c36a850 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.197973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.199174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.207427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 791/1557] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.208275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.218099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e2def-ff6d-4eb9-8d2a-189d1ac74656 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.224067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.224855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.225268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.225720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.226574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.228627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93670adb-670a-447d-9620-68bd6995ddb1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.228780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 767/1558] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.231836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.231836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.231836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.240743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 792/1559] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:43.241963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd81-3841-40a0-85e4-4483db430e91 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.242407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd81-3841-40a0-85e4-4483db430e91 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.242703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd81-3841-40a0-85e4-4483db430e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.249574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.250782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.263483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1b41fd81-3841-40a0-85e4-4483db430e91 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.264753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1b41fd81-3841-40a0-85e4-4483db430e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.311463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 768/1560] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.312622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.322105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398fc4-3e4d-4bf8-8c04-5dd371d84c4d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.324556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 793/1561] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.325832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052549-694a-4603-bf4e-52429c4b1303 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.326120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052549-694a-4603-bf4e-52429c4b1303 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.326397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052549-694a-4603-bf4e-52429c4b1303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.330858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.331568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.331854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.332132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.332852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.333160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.334842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.344693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-dd052549-694a-4603-bf4e-52429c4b1303 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.346565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dd052549-694a-4603-bf4e-52429c4b1303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.347149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 769/1562] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.348673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.354842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 794/1563] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.356225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.356508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.356781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.359557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f397-071d-4ede-b1b3-065b7d52974c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.364196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.364836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.365117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.365389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.366326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.368209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.374060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.375339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.383944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 795/1564] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.385599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.394494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6836-5ec6-402c-aa55-dbdf7419981d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.399480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 770/1565] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.399480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.449102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.449867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.450153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.450460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.451143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.452170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:43.452170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:57:43.452170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:57:43.453380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.458230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45dd7-73d9-4464-9c5f-e6496cb69522 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.463378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.464332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.464574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.464835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] PATH_INFO: `/v3/projects/7d803af3db914e49af007ccfa6809ca2/users/03162807e60044869f0d0acb616c23aa/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.476760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 796/1566] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.476760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.481202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d803af3db914e49af007ccfa6809ca2, user_id=03162807e60044869f0d0acb616c23aa, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.482344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:43.482344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:57:43.482344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:57:43.484175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257cf0-5486-4ab1-904d-85c5e8f99c0a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.484288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.489792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.490778 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.491107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.491417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.492334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.492668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.494511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.499318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 771/1567] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:43 2022] PUT /identity/v3/projects/7d803af3db914e49af007ccfa6809ca2/users/03162807e60044869f0d0acb616c23aa/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:43.505207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.513978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 797/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.513978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.519883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5ba6-7278-44ec-a76d-58a33c064f66 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.566060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42565-8e92-432e-bd22-c056e83d5dea admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.570600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.571262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.571567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.571941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.572643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.572843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.574471 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.575657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.576355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.576644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.576947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.577676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.579588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.586396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 772/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.594481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.604896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c2b91-7a9a-44b5-97fc-101642e8bc84 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.606485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 798/1570] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.607436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.659052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.659827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.660118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.660403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.661127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.661441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.663098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.666732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75574d-613a-4fd4-befd-9fcdedd75d53 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.671318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.671970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.672258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.672541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.673296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:43.674162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.675009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 773/1571] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.675754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.675881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.685274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7dcb-9ed5-4c11-9de6-1e2f4234f9af admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.688056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 799/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:43.688582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.694318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.695066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.695361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.695642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.696353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.698302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2e8d7-43b7-497e-899e-2379db721b27 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.704053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7171f-2ac0-421e-92a2-bfa9762812b4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.709595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.710311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.710660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.711029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.711738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.713442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.723716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 774/1573] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.723716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.723716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.723716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.730335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 800/1574] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:43.730335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.738319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faa8ad-5ed1-476d-87a5-4186b90344a7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.743084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.743719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.744004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.744424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.745207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.747245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.748034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] MFA Rules not processed for user `03162807e60044869f0d0acb616c23aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:43.749278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:43.773185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 801/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.774364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.820303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 775/1576] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:43.820303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.828231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab5b50-4bb2-4dc7-97f8-dab55cfc092c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.834264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.834929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.835216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.835497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.836191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.836643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668481-afe7-4f1f-b933-5b329369e422 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.838151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.841450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.842208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.842498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.842779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.843473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.845984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.860734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 776/1577] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.860734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.870416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472d29-04b4-44a1-a331-80c754785cd8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.874408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 802/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.875067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.878877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.879639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.879925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.880233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.880911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.883356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.911678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 777/1579] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:43.912759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.938908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148346-23ce-4e1f-8ce8-cc819f5a7461 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.974169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef609-f8dd-490c-bee3-14dc00b3791d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:43.978758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.979427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.979770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.980058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.980786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.982548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:43.992911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:43.993583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 778/1580] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:43.993712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:43.993880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:43.994181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:43.994291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:43.994904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:43.996839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.006149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce74bc-cb3a-474b-8495-f3a295cf91b1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.010793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.011585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.011915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.012394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.013375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.015462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.022287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 803/1581] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:43 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:44.023091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.029510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 779/1582] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.030102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.084969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfbc0-48ff-49e6-8adf-10a2c21b016b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.086299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2830-8bd3-42b2-a0e1-1541e06bd716 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.090971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.091634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.091919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.092201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.092888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.094836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.115208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 804/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:44.116097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.127672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2f79-7f38-4b77-93ae-9ec4b2f9ffc2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.132576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.133330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.133727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.134015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.134735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.136362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.136873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.137555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.137872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.138287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.150207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 805/1584] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.150207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.157246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4ec0-47e6-4859-89f0-713751601d0a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.161987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.162626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.162912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.163191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.163866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.165794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.191252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 806/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:44.191252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.197130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.198646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.203070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7be58-190c-485c-a213-9cea9b1f9c8a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.207982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 780/1586] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:44.208819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.208953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.209508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.209799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.210076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.210758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.212681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.219734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ceffb-e832-401c-86d7-074530ed3772 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.226513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.227241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.227593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.227871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.228709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.230473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.233665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 807/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:44.234468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.244109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 781/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.244910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.246221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f4c4-1bbc-4ba4-bf15-30dcaa648afe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.251344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.252747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.253200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.253503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.254234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.255565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe0a1-8f8d-4d40-ab81-3db3b3397497 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.256168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.260223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.261123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.261404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.261729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] PATH_INFO: `/v3/projects/1f4f0f35ae0b4c94977f2e1688dbdb5c/users/8396cfed6d904f859ade91e210c619b5/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.279870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4f0f35ae0b4c94977f2e1688dbdb5c, user_id=8396cfed6d904f859ade91e210c619b5, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.280718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 808/1589] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:44.281358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.285957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.291551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073eb4-5b35-4c18-9269-021df909110e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.296936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.297657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.297945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.298249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.299929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.301206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 782/1590] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/1f4f0f35ae0b4c94977f2e1688dbdb5c/users/8396cfed6d904f859ade91e210c619b5/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:44.301733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.302238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.316341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 809/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.316341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.326656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0d94-09d9-4101-905b-a7e0e57a49c4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.365082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cd2e-301a-4795-9bb0-d0a354df1f27 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.370280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.378128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.378128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.378128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.378128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.378128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.388914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 783/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.388914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.396683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.396926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb099-00a8-4afd-9155-fbe86bd136dd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.397518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.398168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.398534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.399330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.400995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.401951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.402616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.402898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.403183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.403905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.405513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.412161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 810/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.412953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.418842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 784/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.419748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.426545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420b40-da3e-45ab-bf98-16840ed34d1b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.430503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386fee8-4a0f-4ddf-8b95-d1eb7ac82518 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.434309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.435206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.435469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.435738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.435867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] PATH_INFO: `/v3/projects/ae75ee9608724034af8ff61fb6212e62/users/01bb0b5d18ad429ab1ac3e42f66f6bfd/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.436400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.436792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.437072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.437977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.440687 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed00ee-e466-4d91-ad05-5b5f61e888b0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.452100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 785/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.453276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.453592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.453873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.457838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae75ee9608724034af8ff61fb6212e62, user_id=01bb0b5d18ad429ab1ac3e42f66f6bfd, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.462446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.473237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:44.474928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:44.477198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 811/1596] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/ae75ee9608724034af8ff61fb6212e62/users/01bb0b5d18ad429ab1ac3e42f66f6bfd/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:44.477921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.548711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c739-3363-4dc0-aac3-4af7298ac31c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.554425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.555144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.555437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.555719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.556208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 786/1597] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:44.556848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.558006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.561782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.567229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee2a4-fa0f-4cda-84cb-4ff3bfa5c8dd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.571977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.573027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.573395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.573711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] PATH_INFO: `/v3/projects/34db399b717b42f18c5190acb605918f/users/4892d58f399a44b485514cb29f2259b1/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.577516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 812/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.577516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.588645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a852b-9f0d-435f-a348-1a90773bc135 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.593095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=34db399b717b42f18c5190acb605918f, user_id=4892d58f399a44b485514cb29f2259b1, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.596885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.609748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.610368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.610662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.611540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.611970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.612626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 787/1599] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/34db399b717b42f18c5190acb605918f/users/4892d58f399a44b485514cb29f2259b1/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:44.613240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.613779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.629555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 813/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.630643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.641870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0e54b-d36d-4daf-9eaf-3a8e09894a6a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.691246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19163-51fd-405b-8798-9229d79401ab admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.696304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.697028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.697320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.697636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.698369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.700004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceac16-ee1d-42f2-80dc-0fdd0b128df4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.709797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.710622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 788/1601] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.711341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.711784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.712227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.713100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.715013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.715135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117831c-e48f-478e-9245-3c4908b2a036 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.715346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117831c-e48f-478e-9245-3c4908b2a036 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.715634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117831c-e48f-478e-9245-3c4908b2a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.729787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 814/1602] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:44.729787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.745322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c117831c-e48f-478e-9245-3c4908b2a036 None None] MFA Rules not processed for user `01bb0b5d18ad429ab1ac3e42f66f6bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:44.746565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c117831c-e48f-478e-9245-3c4908b2a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:44.791205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23d3d-af29-4c41-80fb-78e3f84c7fd6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.795143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.795812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.796331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.796449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.807138 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.808735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.821228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 815/1603] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:44.822081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.828989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 789/1604] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:44.834191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.834485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.834768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.842717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f961-ca1f-4532-bb75-b9c625aad2d0 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.850618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.854180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:44.855538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:44.863634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.863907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.864158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] PATH_INFO: `/v3/projects/98d1a529cc4d4a11b49d9e08ae5b2f69/users/9fdceba628fb45b0a7d42547cd1c0f4f/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:44.882207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d1a529cc4d4a11b49d9e08ae5b2f69, user_id=9fdceba628fb45b0a7d42547cd1c0f4f, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:44.885364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 790/1605] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:44.886018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:44.886415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.898585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f479a5-20f5-4ab6-9f00-609a262de1bb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:44.905984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 816/1606] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/98d1a529cc4d4a11b49d9e08ae5b2f69/users/9fdceba628fb45b0a7d42547cd1c0f4f/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:44.906933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:44.992919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:44.994364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:44.995809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:44.996555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] PATH_INFO: `/v3/projects/2279e41c4ffe455d9f5d126d3d288333/users/aa2d83bcc02a43f89ba4785a9bdedd15/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.003293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3feb9-eff7-42e7-8098-49e7e250ab31 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.017054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.022299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.023779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.024165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] PATH_INFO: `/v3/projects/8d84ee8b78144447bef24d677ad32b3c/users/28c76d12b0b1436d8eb0b23acf252f25/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.032226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2279e41c4ffe455d9f5d126d3d288333, user_id=aa2d83bcc02a43f89ba4785a9bdedd15, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.042806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.060615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 791/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/2279e41c4ffe455d9f5d126d3d288333/users/aa2d83bcc02a43f89ba4785a9bdedd15/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:45.061334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.065411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d84ee8b78144447bef24d677ad32b3c, user_id=28c76d12b0b1436d8eb0b23acf252f25, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.068678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.092841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 817/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:44 2022] PUT /identity/v3/projects/8d84ee8b78144447bef24d677ad32b3c/users/28c76d12b0b1436d8eb0b23acf252f25/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:45.092841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.163703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301eca9-aced-4261-927d-00c04b0fcdd9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.165447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd000-35c9-4703-8887-979de60b04d7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.168683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.169362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.169659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.169964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.170650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.172552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.174343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.176950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.177615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.178420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] PATH_INFO: `/v3/projects/abb58e6540db42c49d11816cef828917/users/f43d7c592a964772b900de96be6ad69c/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.198998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb58e6540db42c49d11816cef828917, user_id=f43d7c592a964772b900de96be6ad69c, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.205389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31c073-e5f9-4d96-87b1-87db1948590d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.210773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 818/1609] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:45.211761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.223721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 792/1610] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:45 2022] PUT /identity/v3/projects/abb58e6540db42c49d11816cef828917/users/f43d7c592a964772b900de96be6ad69c/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:45.225175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730787-33ac-4907-9427-7db040657f50 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.225492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730787-33ac-4907-9427-7db040657f50 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.225768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730787-33ac-4907-9427-7db040657f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.246028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1a730787-33ac-4907-9427-7db040657f50 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:45.247642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1a730787-33ac-4907-9427-7db040657f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:45.286460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7881e-05d3-477a-811f-62123e7e402d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.317931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 793/1611] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:45.319706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eaa86-8fbd-4534-99b7-cb13920bd7e0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.320236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eaa86-8fbd-4534-99b7-cb13920bd7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.320761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eaa86-8fbd-4534-99b7-cb13920bd7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.341813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a53eaa86-8fbd-4534-99b7-cb13920bd7e0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:45.343978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a53eaa86-8fbd-4534-99b7-cb13920bd7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:45.347529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.348189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.348471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.350924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.362031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 794/1612] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:45.367003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22f7e-75b5-45a8-bf38-dd068f00188d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.367157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.367268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22f7e-75b5-45a8-bf38-dd068f00188d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.367497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22f7e-75b5-45a8-bf38-dd068f00188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.368461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.385729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 819/1613] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:45.386428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-51d22f7e-75b5-45a8-bf38-dd068f00188d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:45.386595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.388031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-51d22f7e-75b5-45a8-bf38-dd068f00188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:45.395883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 795/1614] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:45.397123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.397267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.397558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.411340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac6fc8-6ee9-4634-8a31-5f31975af57b service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.419657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.421783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.422464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.423063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.423881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] MFA Rules not processed for user `f43d7c592a964772b900de96be6ad69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:45.424179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.425180 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:45.427450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.457257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 820/1615] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/users => generated 299 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:45.461438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.474656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77489-b2ad-4158-9a8e-76c108975d48 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.479555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.480203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.480486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.480765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.492425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.493925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.504560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 796/1616] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:45.505439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.505716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 821/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:45.506562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.514686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0d05-2eca-4c33-a1de-b03fb2337c97 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.515141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b0fd-7ba4-4803-a4dd-542bb904761b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.519891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.520434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.521231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.521360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.521572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.521818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.529691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.531341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.532673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.535004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.547007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 822/1618] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:45.547830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.547958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.549952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.559929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52aab-093f-4a75-a442-a26e82f02594 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.561601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 797/1619] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:45.562497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.567026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.567761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.568048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.568326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.569111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.570797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.574709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f860f0-03f0-48ed-b17e-cc07d8a8a652 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.584344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.585629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.588817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.588973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 823/1620] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:45.589089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.589089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.590072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.590209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.603765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0fd59-3790-4819-bca5-f27080cedf98 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.614975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.616850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.617371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.617906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] PATH_INFO: `/v3/projects/2bd9c7a023984e61837a33df1a26cda8/users/8b3683f6e88a4e45ba0c4390bf1a5f14/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.627191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 798/1621] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:45.628822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.643781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd9c7a023984e61837a33df1a26cda8, user_id=8b3683f6e88a4e45ba0c4390bf1a5f14, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.647316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.669814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 824/1622] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:45 2022] PUT /identity/v3/projects/2bd9c7a023984e61837a33df1a26cda8/users/8b3683f6e88a4e45ba0c4390bf1a5f14/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:45.672619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.707517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1f23-365a-4cb5-9e70-bf11abf4f8cd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.765207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384e0c-3264-4fc4-a672-4e593cbd45c2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.773171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.774202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.774541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.775049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.776199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.776624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.777834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.777956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.778440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.778907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.779942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.782269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.792324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 825/1623] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:45.797924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.820890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 799/1624] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:45.825445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0647e-5b36-44d0-b083-8c86f879e88a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.825564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.831811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.831811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.832088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.832724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] PATH_INFO: `/v3/projects/2bd9c7a023984e61837a33df1a26cda8/users/8b3683f6e88a4e45ba0c4390bf1a5f14/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.837453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd9c7a023984e61837a33df1a26cda8, user_id=8b3683f6e88a4e45ba0c4390bf1a5f14, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.840782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70da92-c790-46ac-9bb3-aede75547228 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.849414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83012-d16f-441d-8245-16f39687b379 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:45.859652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 826/1625] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:45 2022] PUT /identity/v3/projects/2bd9c7a023984e61837a33df1a26cda8/users/8b3683f6e88a4e45ba0c4390bf1a5f14/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:45.885646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.886649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.887605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.952645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] MFA Rules not processed for user `8b3683f6e88a4e45ba0c4390bf1a5f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:45.957695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:45.966114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:45.966856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:45.967144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:45.967423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:45.968148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:45.969883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:45.983981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 800/1626] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:45.984940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:45.999054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eeb8e-2602-48cc-8d28-5a4f45c1113d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.006885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.008454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.008847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.009274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] PATH_INFO: `/v3/projects/d601452a9a6247448c9f322104fecf4b/users/ca3772205d4c4b6285d3fce527776a6d/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.071175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d601452a9a6247448c9f322104fecf4b, user_id=ca3772205d4c4b6285d3fce527776a6d, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.078894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.120226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 801/1627] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:45 2022] PUT /identity/v3/projects/d601452a9a6247448c9f322104fecf4b/users/ca3772205d4c4b6285d3fce527776a6d/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:46.125068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:46.140074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 827/1628] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:46.147897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:46.259239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafe9ca-e1dd-4881-99d4-d23e4b58661e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.264121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.264826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.265110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.265396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.266482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.268278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.273835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e17b2-e6c2-45f4-88b5-245a320a7810 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.283594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 802/1629] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:46.284562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:46.294563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3774-4634-447d-9f4f-dee66b1f57a7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.300346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.301547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.301835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.302113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] PATH_INFO: `/v3/projects/d601452a9a6247448c9f322104fecf4b/users/ca3772205d4c4b6285d3fce527776a6d/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.304744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d601452a9a6247448c9f322104fecf4b, user_id=ca3772205d4c4b6285d3fce527776a6d, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.307449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa3abd-eee0-43f3-a358-8f0218c981ac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.330361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 803/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:46 2022] PUT /identity/v3/projects/d601452a9a6247448c9f322104fecf4b/users/ca3772205d4c4b6285d3fce527776a6d/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:46.332245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.332580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.332867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.347074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.347749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.348032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.348311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.362521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] MFA Rules not processed for user `ca3772205d4c4b6285d3fce527776a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:46.364138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:46.455849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 804/1631] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:46.457129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:46.462967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.465042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.482806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 828/1632] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:57:46.532066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:46.540552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba7651-d474-47e3-862f-987cce9076fa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.545693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d60fc-2897-4188-9173-53b295bb5164 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:46.552556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.559593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.560197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.560703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.575559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.578338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c5f37-80bd-479c-abd9-3cdca93434a0 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.612489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 805/1633] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:46.618959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:46.619870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.620130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.620412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] PATH_INFO: `/v3/users/01bb0b5d18ad429ab1ac3e42f66f6bfd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.621675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bb0b5d18ad429ab1ac3e42f66f6bfd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:46.624682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:46.760472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fce0d-1e91-4c62-9e61-e238a72fe00c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.760836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fce0d-1e91-4c62-9e61-e238a72fe00c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.761123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fce0d-1e91-4c62-9e61-e238a72fe00c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.762100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bb0b5d18ad429ab1ac3e42f66f6bfd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:46.763094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 806/1634] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 11 05:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:46.775166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e233d-e601-4d6d-834d-13995fa70fba None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.776140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e233d-e601-4d6d-834d-13995fa70fba None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.776438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e233d-e601-4d6d-834d-13995fa70fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.801734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bb0b5d18ad429ab1ac3e42f66f6bfd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:46.802660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bb0b5d18ad429ab1ac3e42f66f6bfd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:46.803462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bb0b5d18ad429ab1ac3e42f66f6bfd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:46.817390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7d2e233d-e601-4d6d-834d-13995fa70fba None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:46.821329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7d2e233d-e601-4d6d-834d-13995fa70fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:46.821571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61e480a8-9342-485e-9f50-51c5db1e37c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bb0b5d18ad429ab1ac3e42f66f6bfd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:46.851444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 829/1635] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:46 2022] DELETE /identity/v3/users/01bb0b5d18ad429ab1ac3e42f66f6bfd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:46.853140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.856821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.857129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.907683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:46.910118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:46.968628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 807/1636] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 11 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:46.975210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122351-1358-4c90-b343-7208c025bb0f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.975502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122351-1358-4c90-b343-7208c025bb0f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.975788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122351-1358-4c90-b343-7208c025bb0f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:46.977150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 808/1637] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 11 05:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:46.986820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:46.987114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:46.987477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:47.039965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:47.041768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:47.066656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 830/1638] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:47.068090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:47.069658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:47.199930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900987c-7540-4108-9573-ad20170fd0a0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:47.208864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:47.210240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:47.210460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 809/1639] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:47.211402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:47.212081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:47.212379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:47.212804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:47.232242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:47.304125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed9b61-d8ba-40e6-8dfe-2b4a5914f875 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:47.309337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:47.310260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:47.310727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:47.311289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:47.327258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:47.329357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:47.345284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 810/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:47.347483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:47.350351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:47.366858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f3f7-735e-435d-8351-1e16f6900c59 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:47.373172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:47.374105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:47.374461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:47.374811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:47.392785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:47.394435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:47.394634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974472-471f-4041-9a74-46dc67fafea7 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:47.396012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f04c0-d886-4096-9592-961ea1c2a6e8 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:47.417692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 831/1641] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:47.420405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 811/1642] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:47.801665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180aa4-096f-4117-b355-2051e3bba875 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:47.801951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180aa4-096f-4117-b355-2051e3bba875 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:47.802553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180aa4-096f-4117-b355-2051e3bba875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:47.872876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-35180aa4-096f-4117-b355-2051e3bba875 None None] MFA Rules not processed for user `9fdceba628fb45b0a7d42547cd1c0f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:47.874470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-35180aa4-096f-4117-b355-2051e3bba875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.030813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 832/1643] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:48.044316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576367dd-af5e-4c89-9bb6-b828266272bb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.044897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576367dd-af5e-4c89-9bb6-b828266272bb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.044897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576367dd-af5e-4c89-9bb6-b828266272bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.069755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-576367dd-af5e-4c89-9bb6-b828266272bb None None] MFA Rules not processed for user `9fdceba628fb45b0a7d42547cd1c0f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:48.071376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-576367dd-af5e-4c89-9bb6-b828266272bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.095280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 812/1644] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:48.100034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4439c-4d8e-4d48-a57f-11294582f93f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.100351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4439c-4d8e-4d48-a57f-11294582f93f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.100820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4439c-4d8e-4d48-a57f-11294582f93f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.102502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 833/1645] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 11 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:48.113100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.113959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.114681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.151573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:48.153512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.164816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 813/1646] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 11 05:57:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:57:48.172431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4439c-4d8e-4d48-a57f-11294582f93f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:48.201789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4439c-4d8e-4d48-a57f-11294582f93f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:48.217267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:48.217979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.218266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.218542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.242026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:48.243845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617ca0e-df12-4efc-aa19-f193ed537658 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:48.263146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 834/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:48.643436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:48.643661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ce1c-e091-4d72-b6ed-f990e1b0b17a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.643761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ce1c-e091-4d72-b6ed-f990e1b0b17a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.644547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ce1c-e091-4d72-b6ed-f990e1b0b17a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.646520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 835/1648] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 11 05:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:48.648160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.651965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.652260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.652996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.672415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e6a1-ed01-4085-a860-1ae504358399 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:48.680812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:48.685001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.685772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.686763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] PATH_INFO: `/v3/projects/ae75ee9608724034af8ff61fb6212e62` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.690280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae75ee9608724034af8ff61fb6212e62)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:48.694741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:48.697916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:48.699201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.719628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 836/1649] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:57:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:48.734209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:48.735665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.788516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae75ee9608724034af8ff61fb6212e62', 'request_id': 'req-479a9629-13c3-4543-90a8-b70f780d133c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:48.796857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae75ee9608724034af8ff61fb6212e62', 'request_id': 'req-479a9629-13c3-4543-90a8-b70f780d133c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:48.805427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae75ee9608724034af8ff61fb6212e62', 'request_id': 'req-479a9629-13c3-4543-90a8-b70f780d133c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:48.825811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] The token cache is being invalidate because project ae75ee9608724034af8ff61fb6212e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:57:48.826165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:48.826788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:48.827625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74454-8c83-428a-8a2b-687fa352a1d6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:48.832717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 814/1650] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:57:48 2022] DELETE /identity/v3/projects/ae75ee9608724034af8ff61fb6212e62 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:48.834166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:48.835844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.895329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:48.896469 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.897000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.897577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.899635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:48.926298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9629-13c3-4543-90a8-b70f780d133c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:48.932704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:48.933641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:48.934427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:48.934427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] PATH_INFO: `/v3/users/8b3683f6e88a4e45ba0c4390bf1a5f14` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:48.936267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3683f6e88a4e45ba0c4390bf1a5f14)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:48.936791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:48.936791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 11 05:57:48.936791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: May 11 05:57:48.938059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:49.027247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:49.031081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88279ea6-83d0-4970-bd78-a2e9c8949308 service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:49.061622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3683f6e88a4e45ba0c4390bf1a5f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:49.107533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3683f6e88a4e45ba0c4390bf1a5f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:49.109592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 837/1651] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:57:49.137367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3683f6e88a4e45ba0c4390bf1a5f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:49.138240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3683f6e88a4e45ba0c4390bf1a5f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:49.138798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6489c1f-8b54-4fc3-8640-5ddcfb0d374a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3683f6e88a4e45ba0c4390bf1a5f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:49.171243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 815/1652] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:48 2022] DELETE /identity/v3/users/8b3683f6e88a4e45ba0c4390bf1a5f14 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:50.225178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:50.226104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:50.226615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:50.228447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 838/1653] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 11 05:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:50.233937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:50.234463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:50.234561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:50.295660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:50.300030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:50.399510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 816/1654] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:57:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:50.446399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:50.448258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:50.499058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccceb-a9f6-48dd-9911-415ceda9db46 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:50.504905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:50.505745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:50.506109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:50.506866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:50.518154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:50.519796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2181df-d898-45f5-8f8f-e4a1fd4b806e service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:50.529955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 839/1655] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:50.785338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:50.786963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:51.007599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea23d-755c-4993-ad33-682173225e4c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.016718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.018150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.018437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.018715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] PATH_INFO: `/v3/projects/2bd9c7a023984e61837a33df1a26cda8` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.020153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd9c7a023984e61837a33df1a26cda8)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.022384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.152059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd9c7a023984e61837a33df1a26cda8', 'request_id': 'req-eca867ea-c098-4b12-bbb1-ac02a0f3efee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:51.158430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd9c7a023984e61837a33df1a26cda8', 'request_id': 'req-eca867ea-c098-4b12-bbb1-ac02a0f3efee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:51.183635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd9c7a023984e61837a33df1a26cda8', 'request_id': 'req-eca867ea-c098-4b12-bbb1-ac02a0f3efee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:51.227619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] The token cache is being invalidate because project 2bd9c7a023984e61837a33df1a26cda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:57:51.228201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:51.230028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eca867ea-c098-4b12-bbb1-ac02a0f3efee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:51.238047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 817/1656] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:57:50 2022] DELETE /identity/v3/projects/2bd9c7a023984e61837a33df1a26cda8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:51.242416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.242881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.242881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.278669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:51.279990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:51.363682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 840/1657] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:51.371791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.372078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.372616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.401465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:51.403182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:51.418039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.418841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 818/1658] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:51.430581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86040b-146e-427d-ac9b-ff0ca0b07e10 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.436636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.438013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.438639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.439805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.440982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:51.441511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.443511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.473006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.484382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 841/1659] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:57:51.484705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f0565-c84c-4b07-acbd-6a5dfeb23761 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.499346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.500700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.501126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.502268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.503323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.505958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.549464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.559454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 819/1660] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:51 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:51.563368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3bb8-1ce8-4ac8-a886-5d51ef7b55c4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.755351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.756776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.757256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.757906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.759232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.761890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.805684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 842/1661] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:51 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:51.809909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.823907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24abb-be35-4789-8ca7-f45ac3c8fb7f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.830708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.831419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.831709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.831999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.832783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.834571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.852747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 820/1662] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:51.853196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.865336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0073-14a8-446d-aaa7-dcb6cd138bda admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.877547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.878282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.878572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.878851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.879586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.885619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a125787-7c21-4fad-a60e-799b36041aa1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:51.915256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:51.915452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 843/1663] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:51.929226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ddbe6-fd48-4da1-95c7-505ca682ba22 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:51.942961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:51.943878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:51.944168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:51.944453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] PATH_INFO: `/v3/projects/2664b7c5841148dd800738128c1b9ff1/users/a6670cf9d5ec4bad9daf32629e74abfb/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:51.978133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2664b7c5841148dd800738128c1b9ff1, user_id=a6670cf9d5ec4bad9daf32629e74abfb, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:51.982490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:52.036941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578574-8100-4b85-b3e2-c2b2b659c942 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.037454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578574-8100-4b85-b3e2-c2b2b659c942 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.037578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578574-8100-4b85-b3e2-c2b2b659c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.038937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 821/1664] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:51 2022] PUT /identity/v3/projects/2664b7c5841148dd800738128c1b9ff1/users/a6670cf9d5ec4bad9daf32629e74abfb/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:57:52.087035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-69578574-8100-4b85-b3e2-c2b2b659c942 None None] MFA Rules not processed for user `a6670cf9d5ec4bad9daf32629e74abfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:52.088318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-69578574-8100-4b85-b3e2-c2b2b659c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:52.290612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 844/1665] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:52.353899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:52.355708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:52.556724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41c5e-a22a-4efc-8b63-868342895a3a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.557741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41c5e-a22a-4efc-8b63-868342895a3a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.558201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41c5e-a22a-4efc-8b63-868342895a3a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.559463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792811-d594-4a0f-8ce5-ddb73405050b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:52.560241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 845/1666] 10.222.0.44 () {54 vars in 960 bytes} [Wed May 11 05:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:57:52.567111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.567629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.568047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.586401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:52.587173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.587560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.587964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.602824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] MFA Rules not processed for user `bb48776ee54747dfbab78d9caf1f1fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:52.606154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:52.615047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:52.627001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:52.648292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 822/1667] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:52.684548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:52.803510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8a678-1e9d-4051-a3e3-5994b944accc service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:52.818819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:52.819926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.820330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.820712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] PATH_INFO: `/v3/users/a6670cf9d5ec4bad9daf32629e74abfb` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.822190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6670cf9d5ec4bad9daf32629e74abfb)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:52.824339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:52.850130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 846/1668] 10.222.0.44 () {58 vars in 1057 bytes} [Wed May 11 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:52.856987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:52.875665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b36c2-97a4-4f93-bcfd-5d8e449d80cf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:52.900723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:52.903309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:52.905752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:52.906061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:52.912584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:52.967253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6670cf9d5ec4bad9daf32629e74abfb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:52.984756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:52.986635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25826d8a-b483-4d30-8058-e97bcb4ef6ac service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:53.000600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6670cf9d5ec4bad9daf32629e74abfb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:53.023036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 847/1669] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:57:53.029250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6670cf9d5ec4bad9daf32629e74abfb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:53.032615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6670cf9d5ec4bad9daf32629e74abfb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:53.035547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6670cf9d5ec4bad9daf32629e74abfb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:53.076723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 823/1670] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:52 2022] DELETE /identity/v3/users/a6670cf9d5ec4bad9daf32629e74abfb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:57:53.078714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:53.079013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:53.079415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:53.125852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:53.127920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:53.274389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 848/1671] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:53.427818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:53.430965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:53.563113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466f15-8b57-48e5-b9f5-b85552a131dd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:53.576473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:53.577277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:53.577619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:53.577957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:53.593762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:53.595786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1039ee-56fb-4b35-860b-4d55b5149480 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:53.616325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 824/1672] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:55.352439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:55.353918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:55.400696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae058b-460c-493f-8fd8-af5e98161733 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:55.417535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:55.452374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:55.452901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:55.459960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] PATH_INFO: `/v3/projects/2664b7c5841148dd800738128c1b9ff1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:55.461692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2664b7c5841148dd800738128c1b9ff1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:55.462932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 05:57:55.462932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 11 05:57:55.462932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: May 11 05:57:55.464383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:55.762252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2664b7c5841148dd800738128c1b9ff1', 'request_id': 'req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:55.771520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2664b7c5841148dd800738128c1b9ff1', 'request_id': 'req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:55.808062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2664b7c5841148dd800738128c1b9ff1', 'request_id': 'req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:55.878130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] The token cache is being invalidate because project 2664b7c5841148dd800738128c1b9ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:57:55.880824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:55.884450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1cf5431c-f6ba-4c2a-bc21-6efe4fb32a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:55.888865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 849/1673] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:57:55 2022] DELETE /identity/v3/projects/2664b7c5841148dd800738128c1b9ff1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:55.895108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:55.897287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:55.897287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:55.954909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:55.956145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:56.234116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 825/1674] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:56.235400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84fcd2-7be2-4039-898b-e35c4f46079c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.237092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84fcd2-7be2-4039-898b-e35c4f46079c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.237834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84fcd2-7be2-4039-898b-e35c4f46079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:56.357855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5c84fcd2-7be2-4039-898b-e35c4f46079c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:56.406317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5c84fcd2-7be2-4039-898b-e35c4f46079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:56.471611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 850/1675] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:56.475899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:56.486882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571182-0f34-4fb1-ae29-418576629db9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:56.526699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:56.527565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.528173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.528651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:56.529685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:57:56.530435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:56.542994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.543284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.543570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:56.560966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:56.607060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:56.614432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:56.614618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 826/1676] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:57:56.615485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:56.636243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424431-6a63-4004-ac59-4cb41651f10e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:56.650195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:56.652415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.652851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.653825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:56.657181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:56.662299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:56.727459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 827/1677] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:57:56.731541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:56.771455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 851/1678] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:56.868050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8f679-e99e-4042-a3a1-16a1fdeb08b9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:56.881153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:56.885853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.886194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.886634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:56.887519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:56.889772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:56.945041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 828/1679] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:57:56 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:57:56.949220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:56.974180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8494-e17f-429f-8522-39586f97c718 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:56.996427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:56.999368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:56.999703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:56.999998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.000762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:57.002994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:57.034876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:57.035304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 852/1680] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:57.045618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0998b-2a5d-4a3a-a383-a9f0e3531f0c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:57.059037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:57.059886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.060315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.060717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.061616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:57.065214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:57.103489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:57.108098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:57.119232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 829/1681] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:57:57.126994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:57.191199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b6b3-0c60-4fe5-8f14-cce9a39fa00a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:57.214220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:57.215368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.219559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.219966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] PATH_INFO: `/v3/projects/79100e3953e741a296d77db267fe8881/users/347546c08cfc48f9a587a8feabcc9954/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.301775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79100e3953e741a296d77db267fe8881, user_id=347546c08cfc48f9a587a8feabcc9954, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:57.311868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66be81-0dab-48a5-8087-1a5a0698457f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:57.315679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191013f5-9cf1-4806-9d5a-e9fdc3bf444d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:57.337818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:57.338787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.339266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.339733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.349001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 830/1682] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:57:57 2022] PUT /identity/v3/projects/79100e3953e741a296d77db267fe8881/users/347546c08cfc48f9a587a8feabcc9954/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:57.363154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.363681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.365261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.440935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] MFA Rules not processed for user `347546c08cfc48f9a587a8feabcc9954`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:57.442679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:57.499139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:57.501044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58558671-8856-4fef-b100-95de5ffeefa1 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:57.534372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 853/1683] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 05:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 05:57:57.538559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.539098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.539572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.617904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 831/1684] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:57.621577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:57.636866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:57.637971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] MFA Rules not processed for user `8396cfed6d904f859ade91e210c619b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:57.640441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:57.850279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cf13-c4cb-4889-a674-7e37c27caa5c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:57.861500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 854/1685] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:57:57.862227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:57.863047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:57.863447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:57.864057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:57.881317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:57.883417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:57.889890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:57.891845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:57.933776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 832/1686] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:57.963101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:58.089057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f3d0e-7408-4a31-972b-3ccdf3b639b3 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:58.102958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:58.104103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:58.104530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:58.105041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] PATH_INFO: `/v3/users/347546c08cfc48f9a587a8feabcc9954` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:58.106552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=347546c08cfc48f9a587a8feabcc9954)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:58.111704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:58.128029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235886-8b42-4a6f-87c6-649f04075bab None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:58.143189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:58.143867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:58.144154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:58.144430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:58.162794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:58.164441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:58.208379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 855/1687] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:58.289060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347546c08cfc48f9a587a8feabcc9954'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.363164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347546c08cfc48f9a587a8feabcc9954'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.369345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:58.371035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:58.390159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347546c08cfc48f9a587a8feabcc9954'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.391218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347546c08cfc48f9a587a8feabcc9954'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.392313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da78c7f4-69b4-421d-894b-9284bba82c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347546c08cfc48f9a587a8feabcc9954'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.418715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 833/1688] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:57 2022] DELETE /identity/v3/users/347546c08cfc48f9a587a8feabcc9954 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:58.422815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172eff-ec8e-40a5-80f5-490222ec7d0d service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:58.423174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:58.423618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:58.424049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:58.462399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:58.468384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:58.661993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:58.663003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:58.663293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:58.672421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] PATH_INFO: `/v3/users/03162807e60044869f0d0acb616c23aa` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:58.680755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03162807e60044869f0d0acb616c23aa)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:58.687705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:58.708787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 834/1689] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:57:58.728805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:58.730673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:58.802866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03162807e60044869f0d0acb616c23aa'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.841739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03162807e60044869f0d0acb616c23aa'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.844403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03162807e60044869f0d0acb616c23aa'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.847257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03162807e60044869f0d0acb616c23aa'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.868463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de04fdbb-7b3f-48a2-a37c-2be98cabd1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03162807e60044869f0d0acb616c23aa'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:57:58.904166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 856/1690] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:58 2022] DELETE /identity/v3/users/03162807e60044869f0d0acb616c23aa => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:57:58.905974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:58.906265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:58.912367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4be8-54ce-433c-9e0d-fa15ae611909 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:58.916226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:59.038562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:57:59.047833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:59.154853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:59.155549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:59.155730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:59.156010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:59.163403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:59.231503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 857/1691] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:57:59.278299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:59.279904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:59.305027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e33e6-d58b-480c-84d2-e49dd26c95b8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:59.310291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:59.319498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:59.319825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:59.320970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:59.322055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:59.322905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:59.351067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:59.351347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 835/1692] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:57:59.353186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f3ce-bf77-450b-8414-fe4ac4b9cff9 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:59.369449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 858/1693] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:57:59.776869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:57:59.778804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:57:59.814671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fc97-a124-4b08-a298-95bdf235aa4d service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:57:59.834404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:57:59.835428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:57:59.835719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:57:59.838389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] PATH_INFO: `/v3/users/f43d7c592a964772b900de96be6ad69c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:57:59.843196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43d7c592a964772b900de96be6ad69c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:57:59.845902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:57:59.987807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43d7c592a964772b900de96be6ad69c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:00.021059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43d7c592a964772b900de96be6ad69c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:00.038405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43d7c592a964772b900de96be6ad69c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:00.040243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43d7c592a964772b900de96be6ad69c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:00.041659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43d7c592a964772b900de96be6ad69c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:00.070166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 836/1694] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:57:59 2022] DELETE /identity/v3/users/f43d7c592a964772b900de96be6ad69c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:00.074968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493b97-78d7-4ec7-afb9-0586836abc1d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:00.075535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493b97-78d7-4ec7-afb9-0586836abc1d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:00.075799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493b97-78d7-4ec7-afb9-0586836abc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:00.113538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-23493b97-78d7-4ec7-afb9-0586836abc1d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:00.116139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-23493b97-78d7-4ec7-afb9-0586836abc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:00.333980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 859/1695] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:00.446384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:00.448003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:00.598669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702a7c-4301-47e0-a24f-50cf3d48c47d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:00.607460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:00.610095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:00.610444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:00.612021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:00.634683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:00.636344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:00.648969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 837/1696] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:01.872418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:01.873663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:01.874175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:01.935102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:01.939005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:01.961095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 860/1697] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 05:58:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:02.026503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:02.038931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fb23-2a94-4d39-8a0f-9bf6d7af9417 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:02.049457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:02.050961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:02.051260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:02.053319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:02.077518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:02.083043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:02.107949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 838/1698] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:02.763267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:02.765091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:02.805207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95047d3-b444-4c8e-962a-0bd2c1cec91f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:02.818386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:02.822011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:02.828954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:02.828954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] PATH_INFO: `/v3/projects/abb58e6540db42c49d11816cef828917` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:02.828954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb58e6540db42c49d11816cef828917)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:02.832013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:02.969270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb58e6540db42c49d11816cef828917', 'request_id': 'req-6ef38942-0417-4559-a733-582ea49a3875'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:02.986874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb58e6540db42c49d11816cef828917', 'request_id': 'req-6ef38942-0417-4559-a733-582ea49a3875'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.001493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb58e6540db42c49d11816cef828917', 'request_id': 'req-6ef38942-0417-4559-a733-582ea49a3875'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.034061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] The token cache is being invalidate because project abb58e6540db42c49d11816cef828917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:03.034477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.035808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.039364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 861/1699] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:02 2022] DELETE /identity/v3/projects/abb58e6540db42c49d11816cef828917 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:03.043823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:03.068963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c06d-ef95-4f25-ab5d-aa9d11997e83 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:03.267342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:03.273637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:03.274718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:03.275771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] PATH_INFO: `/v3/users/ca3772205d4c4b6285d3fce527776a6d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:03.284234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3772205d4c4b6285d3fce527776a6d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:03.290371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:03.334813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:03.336878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:03.382578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38942-0417-4559-a733-582ea49a3875 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:03.412790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:03.413925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:03.416443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:03.416443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] PATH_INFO: `/v3/projects/79100e3953e741a296d77db267fe8881` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:03.422851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79100e3953e741a296d77db267fe8881)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:03.432342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:03.503892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3772205d4c4b6285d3fce527776a6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.582332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3772205d4c4b6285d3fce527776a6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.624127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3772205d4c4b6285d3fce527776a6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.632434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3772205d4c4b6285d3fce527776a6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.634266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3772205d4c4b6285d3fce527776a6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.634411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79100e3953e741a296d77db267fe8881', 'request_id': 'req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.646323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79100e3953e741a296d77db267fe8881', 'request_id': 'req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.697403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79100e3953e741a296d77db267fe8881', 'request_id': 'req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.726996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 839/1700] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:03 2022] DELETE /identity/v3/users/ca3772205d4c4b6285d3fce527776a6d => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:03.732448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:03.741353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] The token cache is being invalidate because project 79100e3953e741a296d77db267fe8881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:03.741693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.743102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ec6d655-1471-4e2f-b3fd-a4f7694ddb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:03.744682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:03.753386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 862/1701] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:03 2022] DELETE /identity/v3/projects/79100e3953e741a296d77db267fe8881 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:03.755888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb8ec-9cbb-4dc2-8b2c-fbce3710ef08 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:03.758472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb8ec-9cbb-4dc2-8b2c-fbce3710ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:03.759176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb8ec-9cbb-4dc2-8b2c-fbce3710ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:03.810165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8beeb8ec-9cbb-4dc2-8b2c-fbce3710ef08 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:03.813058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8beeb8ec-9cbb-4dc2-8b2c-fbce3710ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:03.960101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc4a0-7270-4ffe-9a85-61df0f133993 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:03.982265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:03.983242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:03.983446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:03.983720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] PATH_INFO: `/v3/projects/7d803af3db914e49af007ccfa6809ca2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:03.989818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d803af3db914e49af007ccfa6809ca2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:03.991506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:04.068096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 863/1702] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:04.076042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.076662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.077204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.135959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d803af3db914e49af007ccfa6809ca2', 'request_id': 'req-cc73989c-6a7a-4a0b-b201-6877bed96180'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:04.165935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d803af3db914e49af007ccfa6809ca2', 'request_id': 'req-cc73989c-6a7a-4a0b-b201-6877bed96180'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:04.169023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:04.170621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:04.188009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d803af3db914e49af007ccfa6809ca2', 'request_id': 'req-cc73989c-6a7a-4a0b-b201-6877bed96180'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:04.237940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] The token cache is being invalidate because project 7d803af3db914e49af007ccfa6809ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:04.238448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:04.239303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc73989c-6a7a-4a0b-b201-6877bed96180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:04.241355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 840/1703] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:03 2022] DELETE /identity/v3/projects/7d803af3db914e49af007ccfa6809ca2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:04.245917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbeea-d202-4b34-9202-378990281620 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.246424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbeea-d202-4b34-9202-378990281620 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.247035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbeea-d202-4b34-9202-378990281620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.318663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-00dcbeea-d202-4b34-9202-378990281620 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:04.320149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00dcbeea-d202-4b34-9202-378990281620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:04.412314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 864/1704] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:04.413546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:04.446859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb7cd6-987e-4181-9563-f650cb51a311 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:04.465937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:04.467175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.468365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.471770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.474067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:04.475858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:04.483886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:04.511816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 841/1705] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:04.516457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.516784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.517066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.538168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 865/1706] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:04.540539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:04.576657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af9d0-15f7-4897-be81-873a7aedb1f3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:04.598585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:04.601626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.603604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.606351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.607789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:04.614645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:04.615880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:04.617635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:04.636969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 842/1707] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:04.637695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:04.662090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa448-c435-4188-9d9f-c1d624080670 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:04.680348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:04.681034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.681361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.683892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.684717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:04.685033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:04.686696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:04.728376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 866/1708] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:04.731879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:04.741994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 843/1709] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:58:04.744448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:04.776983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42d3-41b5-4407-9012-52238a46a4a7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:04.965082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:04.966504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:04.966796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:04.967558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:04.968301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:04.986853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:04.990387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a03b-f4c9-4efb-9558-1961589181a9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.014395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.015108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.015443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.017509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.026237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.038826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.073422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 844/1710] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/projects => generated 405 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:05.075223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.098090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 867/1711] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:04 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:05.099819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.128217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b5f3-de0b-49a9-a73f-aa9ac9b898f3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.327075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8752-b270-49c8-a2ce-2a8acb49b6c3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.334941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.340880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.341183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.341493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.342228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.344750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908648db-1caf-4db2-9f81-39c0e93f6b23 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.383227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.384341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.384543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.384834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.390635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.405304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 845/1712] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:05 2022] POST /identity/v3/users => generated 303 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:05.405796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.415749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.416155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.417655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.435743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 868/1713] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:05.436706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.470506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232692b2-1e0b-4a60-aa9a-b19a2135301d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.489806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.494451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.494787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.495087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.495559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] MFA Rules not processed for user `4892d58f399a44b485514cb29f2259b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:05.496818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:05.498080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.504978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.555962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 869/1714] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:05.556725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.597271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5372d1-a145-4df3-8da2-e7951d3a739a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.614658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.615760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.616148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.616435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.617257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.623058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.632554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 846/1715] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:05.642609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.659367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 870/1716] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:05.660800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.665219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:05.675161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b163-0531-43dd-ac9b-eba8fea0e3f0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.695668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.696316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.696603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.696886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.697686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.699307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.722361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 847/1717] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:05.723329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.762157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ceaa-6f83-4407-8345-78ac267469be admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:05.788837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:05.789814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:05.790105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:05.790383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] PATH_INFO: `/v3/projects/2d88dd4f26c44f4f95eb517b822ee511/users/7a1de7ad37d3481da215f58c8eb3991c/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:05.843210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d88dd4f26c44f4f95eb517b822ee511, user_id=7a1de7ad37d3481da215f58c8eb3991c, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:05.846904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:05.884453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 848/1718] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:05 2022] PUT /identity/v3/projects/2d88dd4f26c44f4f95eb517b822ee511/users/7a1de7ad37d3481da215f58c8eb3991c/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:05.884453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:05.924295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77974e-24f8-49a1-8229-09424f3cc235 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:06.118307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e14c2-1a35-4a7f-879a-39670b5f205a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:06.136043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:06.136957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.137247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.137678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] PATH_INFO: `/v3/projects/e8008e7cc7cb4ec3a745411d888787fc/users/bacd147182e14e448ac201f9b6f279a6/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.180932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8008e7cc7cb4ec3a745411d888787fc, user_id=bacd147182e14e448ac201f9b6f279a6, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:06.184057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd3d0-3978-4820-8d9e-20eed221db70 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:06.211395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:06.212066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.212351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.221422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 849/1719] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:05 2022] PUT /identity/v3/projects/e8008e7cc7cb4ec3a745411d888787fc/users/bacd147182e14e448ac201f9b6f279a6/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:06.221422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.221422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.221422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.221899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.273532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] MFA Rules not processed for user `7a1de7ad37d3481da215f58c8eb3991c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:06.274854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:06.334170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:06.342024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4b7a6-f88c-4ed5-a930-f6332b6e0de5 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:06.412779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 871/1720] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:06.421795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.425618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.426094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.485427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 850/1721] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:06.486666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:06.599285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] MFA Rules not processed for user `bacd147182e14e448ac201f9b6f279a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:06.601943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:06.685436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce679-21f8-4cfd-af9a-e826224663f9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:06.694085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:06.696103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.697498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.698069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.706476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:06.710063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:06.772736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 851/1722] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:06.774094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:06.795079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 872/1723] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:06.796308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:06.822419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b98f2-d483-4939-9527-2de04318d76c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:06.966347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4907-21ee-4c06-b963-6a6a10c9d95d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:06.989388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:06.990708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:06.990708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:06.990708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:06.991382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:06.993415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:06.999712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.000615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.003718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.006518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.009006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.016453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.040689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 852/1724] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:06 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:07.050860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.069610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e6d8-fee6-4733-8be9-5fd44b27505e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.076210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.076969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.077294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.077751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.081793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.082275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 873/1725] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:06 2022] POST /identity/v3/projects => generated 403 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:07.083990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.084798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.100984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 853/1726] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:07.110416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.157774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542663-ddcc-4003-991e-9a1e82e49d34 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.300552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b13e-a9ce-4d5d-af09-3ce72b8e8c9c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.316204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.316957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.317280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.317609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.322685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.324697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.378501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 874/1727] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:07 2022] POST /identity/v3/users => generated 308 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:07.380935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.408446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6f12-41b1-4541-9ed6-bc649f161ede admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.420886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.421513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.421808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.422104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.423714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.448219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.456619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.458557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.458919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.459212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.466500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.473649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.488085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 875/1728] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:07.491230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.521519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 854/1729] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:07.528905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.529456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ea52b-22d7-44b4-8938-5c77b9ced2ee admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.551121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.551849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.552139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.552436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] PATH_INFO: `/v3/projects/ea3f19c426ae404193844d49eba8edf3/users/8df9fd0c15614defa010300cb765760c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.559014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfee9a-e808-412b-9cf1-7b0dfc2de3b0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:07.574043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:07.574928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.575213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.575489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] PATH_INFO: `/v3/projects/40c7d054df6644c6a589f18d7c04d78d/users/acd09289a87e4a75a6537643a8266ac1/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.604841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c7d054df6644c6a589f18d7c04d78d, user_id=acd09289a87e4a75a6537643a8266ac1, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.608006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.618533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3f19c426ae404193844d49eba8edf3, user_id=8df9fd0c15614defa010300cb765760c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:07.631758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 855/1730] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:07 2022] PUT /identity/v3/projects/40c7d054df6644c6a589f18d7c04d78d/users/acd09289a87e4a75a6537643a8266ac1/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:07.633939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:07.645434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:07.646967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3406d-9b17-4443-b227-7506807a17dc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:07.697292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 876/1731] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:07 2022] PUT /identity/v3/projects/ea3f19c426ae404193844d49eba8edf3/users/8df9fd0c15614defa010300cb765760c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:07.697292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:07.697292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:07.697737 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:07.768105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] MFA Rules not processed for user `acd09289a87e4a75a6537643a8266ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:07.769814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:07.886360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0934c88-2672-4107-91a6-8639702bf39b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.010651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 877/1732] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:08.014108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:08.057452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.058654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.059087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.059513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] PATH_INFO: `/v3/projects/d601452a9a6247448c9f322104fecf4b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.060975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d601452a9a6247448c9f322104fecf4b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.064461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.144242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9f9e7-4273-4f4e-b6c8-9b289ee97b97 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.144442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd601452a9a6247448c9f322104fecf4b', 'request_id': 'req-c71641a2-daad-42ce-8ea3-60f1282ddb0f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:08.151615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd601452a9a6247448c9f322104fecf4b', 'request_id': 'req-c71641a2-daad-42ce-8ea3-60f1282ddb0f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:08.164243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd601452a9a6247448c9f322104fecf4b', 'request_id': 'req-c71641a2-daad-42ce-8ea3-60f1282ddb0f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:08.186010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] The token cache is being invalidate because project d601452a9a6247448c9f322104fecf4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:08.186424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:08.187119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c71641a2-daad-42ce-8ea3-60f1282ddb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:08.190964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 856/1733] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:07 2022] DELETE /identity/v3/projects/d601452a9a6247448c9f322104fecf4b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:08.193345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e9fa-402e-4b41-8d04-ac567f1b8727 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.193688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e9fa-402e-4b41-8d04-ac567f1b8727 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.194402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e9fa-402e-4b41-8d04-ac567f1b8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.227840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9b63e9fa-402e-4b41-8d04-ac567f1b8727 None None] MFA Rules not processed for user `8396cfed6d904f859ade91e210c619b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:08.229493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9b63e9fa-402e-4b41-8d04-ac567f1b8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:08.262593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.264021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.267558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.267900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.268688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.271564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.299654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 878/1734] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:08.299980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:08.302193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:08.363879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d87c-3908-43c6-9789-eb1a5418a9b0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.376386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 857/1735] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:08.382264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.384261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.386794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.387946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.394070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.396996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.397509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.398715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.399216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.465874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:08.468421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:08.474543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 879/1736] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:08.477240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:08.481995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:08.626699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 858/1737] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:08.627928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:08.655970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76da31-c5fa-48ee-9619-070a36520782 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.677769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.680240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.681676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.682229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.682972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.687868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16e03-8797-4140-9405-5d038174fe8c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.738360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a6fd0-b772-4a6e-8966-5510ec946755 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.751850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.752787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.753076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.753361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] PATH_INFO: `/v3/projects/ea3f19c426ae404193844d49eba8edf3/users/8df9fd0c15614defa010300cb765760c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.760283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 859/1738] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:08.761706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3f19c426ae404193844d49eba8edf3, user_id=8df9fd0c15614defa010300cb765760c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.761998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2321e1e-578d-4b08-9228-0472c647c6ed None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.762292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2321e1e-578d-4b08-9228-0472c647c6ed None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.762572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2321e1e-578d-4b08-9228-0472c647c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.764414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.793292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 880/1739] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:08 2022] PUT /identity/v3/projects/ea3f19c426ae404193844d49eba8edf3/users/8df9fd0c15614defa010300cb765760c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:08.794199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:08.830197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d2321e1e-578d-4b08-9228-0472c647c6ed None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:08.831456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d2321e1e-578d-4b08-9228-0472c647c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:08.957547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91e0f-e2c2-458b-9621-074cd136ee59 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:08.971637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:08.972335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.972627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.972913 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:08.973720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:08.975487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:08.976753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 860/1740] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:08.980996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:08.981288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:08.981638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.005841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 881/1741] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:09.006795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.031350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9a00-c043-4b56-aff1-84acbec6b6a2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.045189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.046052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.046352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.046638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.048064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:09.048416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:09.050064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:09.051896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] MFA Rules not processed for user `8df9fd0c15614defa010300cb765760c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:09.053255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:09.082192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 882/1742] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:09.083076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.109643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972f3-f711-41d8-915d-bc7977d4e306 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.123304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.124237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.124530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.124828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] PATH_INFO: `/v3/projects/6fd02527260140a590e6da7b1e2af725/users/9cfc096ef8764eac8345a4513486eacb/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.160746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd02527260140a590e6da7b1e2af725, user_id=9cfc096ef8764eac8345a4513486eacb, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:09.170718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:09.211313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 883/1743] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:09 2022] PUT /identity/v3/projects/6fd02527260140a590e6da7b1e2af725/users/9cfc096ef8764eac8345a4513486eacb/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:09.221048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.248482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 861/1744] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:09.256040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.264687 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93f2d8-4e2d-4066-a25b-e5c82253ece3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.366714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ea1e-abb1-4cd9-ad26-b4fbeccd2249 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.385355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.386121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.386418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.387344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.388060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:09.404329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:09.410391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.411664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.412026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.412368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.413622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:09.418754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:09.448101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 862/1745] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:09.450930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.464714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:09.474468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 884/1746] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:09 2022] POST /identity/v3/projects => generated 363 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:09.476977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.616014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c64b4-c372-46e0-9f67-1773e5b47505 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.706571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e4288-aa64-49a3-b405-b21f45e0a448 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:09.719042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.723227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.723522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.723807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] PATH_INFO: `/v3/projects/6fd02527260140a590e6da7b1e2af725/users/9cfc096ef8764eac8345a4513486eacb/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.728051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd02527260140a590e6da7b1e2af725, user_id=9cfc096ef8764eac8345a4513486eacb, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:09.734744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:09.808108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 885/1747] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:09 2022] PUT /identity/v3/projects/6fd02527260140a590e6da7b1e2af725/users/9cfc096ef8764eac8345a4513486eacb/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:09.809151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:09.816863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:09.817621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:09.818420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:09.818694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:09.987525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665995-312f-4dd0-9ccf-591de33d1975 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.027866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.028632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.028922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.029295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.030096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.033498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc645f-9057-4ba4-8996-9c045d267423 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.118538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.124257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 886/1748] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:09 2022] POST /identity/v3/users => generated 282 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:10.124896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e71b75-e9a5-4911-a4af-a84815184f98 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.126238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6ca8-3e7a-475a-b2b0-b9f1f5286c39 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.126554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6ca8-3e7a-475a-b2b0-b9f1f5286c39 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.126842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6ca8-3e7a-475a-b2b0-b9f1f5286c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.164565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 863/1749] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:10.172227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639e0b-70f4-4305-9647-7975e257374f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.172812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639e0b-70f4-4305-9647-7975e257374f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.173293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639e0b-70f4-4305-9647-7975e257374f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.180889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 864/1750] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:58:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:58:10.181923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94639e0b-70f4-4305-9647-7975e257374f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:10.239028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-004b6ca8-3e7a-475a-b2b0-b9f1f5286c39 None None] MFA Rules not processed for user `9cfc096ef8764eac8345a4513486eacb`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:10.246086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-004b6ca8-3e7a-475a-b2b0-b9f1f5286c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:10.246611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94639e0b-70f4-4305-9647-7975e257374f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.260396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.261360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.261721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.262004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.262794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.264325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.277571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 865/1751] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:10.281791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:10.339071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413cd25-2861-43e9-aec4-cfc979e72bd1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.355578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.366471 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.366580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.366865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.367625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.369263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.418508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 887/1752] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:10.420074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.420555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.420840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.422568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 866/1753] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:10.423848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:10.445822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:10.447625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:10.476451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b82f-bd9a-4537-a5ba-27af000dcf45 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.492707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.494142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.494431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.494713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] PATH_INFO: `/v3/projects/9610416347644334b308a82385c3c8d2/users/545b329869fb4869b8a24ac96bd0ae89/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.532878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9610416347644334b308a82385c3c8d2, user_id=545b329869fb4869b8a24ac96bd0ae89, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.536455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.576342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 867/1754] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:10 2022] PUT /identity/v3/projects/9610416347644334b308a82385c3c8d2/users/545b329869fb4869b8a24ac96bd0ae89/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:10.577446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:10.582558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:10.621940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 888/1755] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:58:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:10.622933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:10.661287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43173f-e470-49c8-b50c-0d3007b166e4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.805543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c6b3-c5ec-4580-b822-e39f67367c4e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:10.818392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.819068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.819372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.819640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.824876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:10.881485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:10.886720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.887123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.887501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] PATH_INFO: `/v3/users/bacd147182e14e448ac201f9b6f279a6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:10.888923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacd147182e14e448ac201f9b6f279a6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.891379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.946482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:10.951142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683c345-1278-4640-a2b6-d8f642568f4c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:10.976416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 868/1756] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:10.978903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d07fbb-6bb0-496b-a8f1-c1aa3a837a00 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:10.979135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d07fbb-6bb0-496b-a8f1-c1aa3a837a00 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:10.983408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d07fbb-6bb0-496b-a8f1-c1aa3a837a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:11.046298 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b8d07fbb-6bb0-496b-a8f1-c1aa3a837a00 None None] MFA Rules not processed for user `545b329869fb4869b8a24ac96bd0ae89`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:11.050854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b8d07fbb-6bb0-496b-a8f1-c1aa3a837a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.107442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacd147182e14e448ac201f9b6f279a6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:11.146793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacd147182e14e448ac201f9b6f279a6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:11.147950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacd147182e14e448ac201f9b6f279a6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:11.148757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacd147182e14e448ac201f9b6f279a6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:11.168058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacd147182e14e448ac201f9b6f279a6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:11.228016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 889/1757] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:10 2022] DELETE /identity/v3/users/bacd147182e14e448ac201f9b6f279a6 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:11.229591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:11.234005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.292371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 869/1758] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:11.295819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:11.296108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:11.296388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:11.322757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:11.324392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.449337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370b1d-44c3-45f2-a8da-f16b9c16cc33 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:11.463636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:11.464929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:11.465336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:11.465730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:11.469078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.508395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:11.511692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:11.538181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 890/1759] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:11.539852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 870/1760] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:11.543187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:11.545043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.594580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a080d4-d6d1-4089-a0ae-1ee4c34ef66a service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:11.606266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:11.607113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:11.607498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:11.609040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:11.610946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:11.616935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:11.696286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 891/1761] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:11 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:11.700167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:11.711734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68256d-44f6-408b-bf8e-e4cd2f3b2da6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:11.750101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:11.754501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:11.892531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:11.893972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:11.894459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:11.895028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:11.895958 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:11.898193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:11.973386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 871/1762] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:11 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:11.982900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:11.998185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff4be-61c4-4fd5-90b9-d196bd2981aa admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.019114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd515-b057-4c12-838c-576f01ee8e9b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.031601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.033400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.034004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.034531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.035955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.040030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.049500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.051034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.051737 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.052121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.086674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.093277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.095951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 872/1763] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:12.097108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:12.148068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 892/1764] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:58:12.148657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf80d-4ff0-431b-90c8-3ac61ca5cedb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.166909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.168848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.169777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.170941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] PATH_INFO: `/v3/projects/28794a6001374d62b939a2570f47ef54/users/c6eac305f2494214a8bd8743811c3a3c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.204245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28794a6001374d62b939a2570f47ef54, user_id=c6eac305f2494214a8bd8743811c3a3c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.208777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.245496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 873/1765] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:12 2022] PUT /identity/v3/projects/28794a6001374d62b939a2570f47ef54/users/c6eac305f2494214a8bd8743811c3a3c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:12.249501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:12.283037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cec4d-2116-496e-b628-87c3831d22e8 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.403916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.404794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.405691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.405987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.407431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.410319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6a785-85f1-4ef1-87e7-63587d04cdc8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.433381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 893/1766] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:12.437494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:12.460522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eece7-abe0-48c6-8236-7ffe704dae5e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.476630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.477588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.477920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.478203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] PATH_INFO: `/v3/projects/28794a6001374d62b939a2570f47ef54/users/c6eac305f2494214a8bd8743811c3a3c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.484022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] RBAC: Authorizing `identity:create_grant(project_id=28794a6001374d62b939a2570f47ef54, user_id=c6eac305f2494214a8bd8743811c3a3c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.489229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.519770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 874/1767] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:12 2022] PUT /identity/v3/projects/28794a6001374d62b939a2570f47ef54/users/c6eac305f2494214a8bd8743811c3a3c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:12.531634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc608-2043-4d37-830f-b86fd321d2f1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.532789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc608-2043-4d37-830f-b86fd321d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.532957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc608-2043-4d37-830f-b86fd321d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.564188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3eebc608-2043-4d37-830f-b86fd321d2f1 None None] MFA Rules not processed for user `c6eac305f2494214a8bd8743811c3a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:12.565633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3eebc608-2043-4d37-830f-b86fd321d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:12.676953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 894/1768] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:12.686942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:12.689377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:12.744591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.744943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.745815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.765671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] MFA Rules not processed for user `4892d58f399a44b485514cb29f2259b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:12.768163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:12.788440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62e37-b86b-403d-812a-93ef4bf436af admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:12.800380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:12.801067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:12.801354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:12.801933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:12.818824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:12.821252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:12.836283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 875/1769] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:12.841536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 895/1770] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:13.444968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:13.450369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:13.465232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e50e4-0f49-4a03-b49c-581dbb327865 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:13.471085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:13.475662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:13.477458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:13.477985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:13.486870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:13.567214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:13.569156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938ebb-1e2f-4c12-bdfb-bd45080305cd service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:13.582618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 876/1771] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:13.666512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:13.771676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14dd27-b50b-4b9c-9400-38097ad538c2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:13.779217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:13.780924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:13.781485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:13.781875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] PATH_INFO: `/v3/users/545b329869fb4869b8a24ac96bd0ae89` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:13.784611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545b329869fb4869b8a24ac96bd0ae89)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:13.787064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:13.865386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545b329869fb4869b8a24ac96bd0ae89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:13.880465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545b329869fb4869b8a24ac96bd0ae89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:13.881315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545b329869fb4869b8a24ac96bd0ae89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:13.882062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545b329869fb4869b8a24ac96bd0ae89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:13.893042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545b329869fb4869b8a24ac96bd0ae89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:13.935475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 896/1772] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:13 2022] DELETE /identity/v3/users/545b329869fb4869b8a24ac96bd0ae89 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:13.940935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:13.941232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:13.941569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:13.979404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:13.981691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.108277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 877/1773] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:14.113051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:14.114689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.137309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65491c-28e8-4c51-b181-9ce3c2871043 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:14.159312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:14.160479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.160927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.161369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] PATH_INFO: `/v3/projects/e8008e7cc7cb4ec3a745411d888787fc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.162014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:14.162784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8008e7cc7cb4ec3a745411d888787fc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:14.163894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.165847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:14.294566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8008e7cc7cb4ec3a745411d888787fc', 'request_id': 'req-be4f70a6-47c7-4362-89ef-ce0a4904b15c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.306018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8008e7cc7cb4ec3a745411d888787fc', 'request_id': 'req-be4f70a6-47c7-4362-89ef-ce0a4904b15c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.323929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8008e7cc7cb4ec3a745411d888787fc', 'request_id': 'req-be4f70a6-47c7-4362-89ef-ce0a4904b15c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.366372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] The token cache is being invalidate because project e8008e7cc7cb4ec3a745411d888787fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:14.366681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.369965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be4f70a6-47c7-4362-89ef-ce0a4904b15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.371333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98408db-4cd4-4c5b-afb7-73aeb0c77953 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:14.374859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 897/1774] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:14 2022] DELETE /identity/v3/projects/e8008e7cc7cb4ec3a745411d888787fc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:14.374859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.374859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.374859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.446402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] MFA Rules not processed for user `28c76d12b0b1436d8eb0b23acf252f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:14.456251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.516640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:14.518236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.518708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.519148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.522378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.580780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 898/1775] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:14.593201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:14.595021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.671812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:14.675513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3729a-6905-490b-961b-d3c9e848341b service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:14.712576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 878/1776] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:58:14.714118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee792807-f1d4-4121-baa8-697f62a9513f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.714577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee792807-f1d4-4121-baa8-697f62a9513f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.715012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee792807-f1d4-4121-baa8-697f62a9513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.753365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3299-f031-45d8-a2a1-b3322e95559b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:14.759822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ee792807-f1d4-4121-baa8-697f62a9513f None None] MFA Rules not processed for user `aa2d83bcc02a43f89ba4785a9bdedd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:14.761526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ee792807-f1d4-4121-baa8-697f62a9513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.771570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:14.779044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.779330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.779774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] PATH_INFO: `/v3/users/8df9fd0c15614defa010300cb765760c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.784601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df9fd0c15614defa010300cb765760c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:14.794501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:14.869364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 879/1777] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:14.872324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e1f1-5472-4d89-aff6-9e64f7fc0acc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.872628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e1f1-5472-4d89-aff6-9e64f7fc0acc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.873011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e1f1-5472-4d89-aff6-9e64f7fc0acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.897002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df9fd0c15614defa010300cb765760c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.898156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5d54e1f1-5472-4d89-aff6-9e64f7fc0acc None None] MFA Rules not processed for user `28c76d12b0b1436d8eb0b23acf252f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:14.900214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5d54e1f1-5472-4d89-aff6-9e64f7fc0acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.912940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 880/1778] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:14.915152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.915152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.915152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:14.917023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 881/1779] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 11 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:58:14.918071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:14.920011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:14.933324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df9fd0c15614defa010300cb765760c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.934237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df9fd0c15614defa010300cb765760c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.936461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df9fd0c15614defa010300cb765760c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.957750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4e9d579e-4081-4722-8fab-9b4c59441e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df9fd0c15614defa010300cb765760c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:14.982685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 899/1780] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:14 2022] DELETE /identity/v3/users/8df9fd0c15614defa010300cb765760c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:14.983943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:14.984238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:14.984858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.013658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745057b-f80f-48d3-8b05-3b8998c5fab4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:15.028190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:15.029923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.078468 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:15.079900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:15.080196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:15.080480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.082632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.153114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 900/1781] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:15.155210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:15.161163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.199181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:15.201611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:15.227935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 882/1782] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:15.233609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:15.238266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.277461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e104d08-db96-4df5-9016-53008c6beda2 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:15.289272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:15.290604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:15.292815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:15.293108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.317677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:15.321071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:15.348870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab6953-266d-4525-bb3b-3880db59c57d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:15.349923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 883/1783] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:15.370460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:15.371141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:15.371425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:15.371709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.377953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.501046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:15.502847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:15.518610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:15.520995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.545901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 901/1784] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:15.692553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:15.714617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099dbd-b750-4c65-8804-95f4d58b6cf5 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:15.739076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:15.740103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:15.740529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:15.740957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.744972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:15.794282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbe98-87c9-4e3f-9e7d-b6422d08af46 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:15.813614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:15.814510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:15.814793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:15.823741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] PATH_INFO: `/v3/projects/9610416347644334b308a82385c3c8d2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:15.826146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9610416347644334b308a82385c3c8d2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:15.828148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:15.892169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:15.899827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:15.928961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 902/1785] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:15.974350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9610416347644334b308a82385c3c8d2', 'request_id': 'req-a1bbb803-551a-4d78-95cd-e457bfc4c737'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:15.990301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9610416347644334b308a82385c3c8d2', 'request_id': 'req-a1bbb803-551a-4d78-95cd-e457bfc4c737'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.006515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9610416347644334b308a82385c3c8d2', 'request_id': 'req-a1bbb803-551a-4d78-95cd-e457bfc4c737'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.028025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] The token cache is being invalidate because project 9610416347644334b308a82385c3c8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:16.028226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.028830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.032812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 884/1786] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:15 2022] DELETE /identity/v3/projects/9610416347644334b308a82385c3c8d2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:16.036988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:16.083198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fed246-db89-4e9d-9958-f6728c7a7fc9 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:16.118132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:16.119519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:16.167943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:16.169656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:16.170106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:16.170651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] PATH_INFO: `/v3/users/c6eac305f2494214a8bd8743811c3a3c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:16.172395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6eac305f2494214a8bd8743811c3a3c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:16.175074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:16.285087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6eac305f2494214a8bd8743811c3a3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.325251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6eac305f2494214a8bd8743811c3a3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.327786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6eac305f2494214a8bd8743811c3a3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.330319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6eac305f2494214a8bd8743811c3a3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.335373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb803-551a-4d78-95cd-e457bfc4c737 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:16.349655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:16.350268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85583bc8-aaa0-4bd3-8d38-2503ca48cb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6eac305f2494214a8bd8743811c3a3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.350546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:16.350829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:16.351114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] PATH_INFO: `/v3/projects/ea3f19c426ae404193844d49eba8edf3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:16.354558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3f19c426ae404193844d49eba8edf3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:16.361399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:16.373356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 903/1787] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:16 2022] DELETE /identity/v3/users/c6eac305f2494214a8bd8743811c3a3c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:16.502114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3f19c426ae404193844d49eba8edf3', 'request_id': 'req-cbcd5f73-6fa2-40b7-862d-6ca74297d801'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.518514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3f19c426ae404193844d49eba8edf3', 'request_id': 'req-cbcd5f73-6fa2-40b7-862d-6ca74297d801'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.525845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3f19c426ae404193844d49eba8edf3', 'request_id': 'req-cbcd5f73-6fa2-40b7-862d-6ca74297d801'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.555542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] The token cache is being invalidate because project ea3f19c426ae404193844d49eba8edf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:16.557029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.558728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cbcd5f73-6fa2-40b7-862d-6ca74297d801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:16.565172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 885/1788] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:16 2022] DELETE /identity/v3/projects/ea3f19c426ae404193844d49eba8edf3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:16.570191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:16.570719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:16.571336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:16.629376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:16.631748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:16.889047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 904/1789] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:16.897274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:16.898962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:16.899434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:16.941506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:16.943153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:16.961525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 886/1790] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:16.964682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:16.979192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9980-5dd8-4d6e-b9f7-9ec07023ddc0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:16.996981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:16.997864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.000322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.001541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.004876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:17.005392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.009563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.038304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 905/1791] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:17.042036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:17.055965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b48e-c6a3-4458-b259-a73da424f482 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:17.064570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:17.065566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.065924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.066747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.075563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.087163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.147684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 887/1792] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:17 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:17.151761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:17.175510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c738bf-bfb9-42cd-a303-8ba37940d25f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:17.334439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:17.341417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.341774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.342058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.343384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.345877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.429946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 906/1793] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:17 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:17.433983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:17.446563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ec1c-fb59-404b-93c1-4c0fd9eb4a51 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:17.452081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:17.452893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.453425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.454369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.455388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.458493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.471905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 888/1794] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:17.475440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:17.486591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf79c6-aea4-49be-b361-10d226edb4fd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:17.499382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:17.500087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.500446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.500743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.501494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.504284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c3a2e-26eb-40ba-b8fc-429cf1a40588 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.554315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 907/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:17.555436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:17.566602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54727-57a6-4b41-98a1-56938b7f7c7e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:17.585147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:17.586431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.586729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.587039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] PATH_INFO: `/v3/projects/239d158ff0bc4d2493e5b30737fa35b3/users/0efaa389113f4c35a70a9a0a32ec0269/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.631056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239d158ff0bc4d2493e5b30737fa35b3, user_id=0efaa389113f4c35a70a9a0a32ec0269, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:17.638050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:17.685328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 889/1796] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:17 2022] PUT /identity/v3/projects/239d158ff0bc4d2493e5b30737fa35b3/users/0efaa389113f4c35a70a9a0a32ec0269/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:17.700884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:17.701205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:17.701547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:17.924409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] MFA Rules not processed for user `0efaa389113f4c35a70a9a0a32ec0269`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:17.942186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:18.051579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.053824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:18.115072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 908/1797] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:18.116170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.229504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f2303-6aa7-4a43-b41d-53dc950bed22 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.235437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:18.236730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.237022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.237507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.238280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:18.241294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:18.321157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 909/1798] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:18 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:18.323805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.386077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726b8f1-9acc-4d00-a2fa-d300938ba163 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.474435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc123d89-666f-49b8-8258-35736d7958d5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.485829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:18.486664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.486946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.487231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.487910 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:18.489892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:18.538903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 910/1799] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:18 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:18.540063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.560473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ba86-77c0-4e50-94ff-ebd7fe5e4b23 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.586336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:18.587317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.587610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.587888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.588628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:18.590282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:18.604250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 911/1800] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:18.610229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.629180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152c8a-2718-47ee-a16a-1f3c95c445f4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.650601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:18.652815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.655873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.656303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] PATH_INFO: `/v3/projects/28794a6001374d62b939a2570f47ef54` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.660324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=28794a6001374d62b939a2570f47ef54)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:18.665405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:18.670629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:18.671480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.672599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.687094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.687754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:18.701431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8a41d-06b5-4030-b500-33797347385a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:18.726298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 912/1801] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:18.727979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.728436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.729658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.756702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] MFA Rules not processed for user `28c76d12b0b1436d8eb0b23acf252f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:18.759159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:18.825464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28794a6001374d62b939a2570f47ef54', 'request_id': 'req-09cae323-4e56-4a20-af4a-3285a7526bbd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:18.839496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28794a6001374d62b939a2570f47ef54', 'request_id': 'req-09cae323-4e56-4a20-af4a-3285a7526bbd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:18.856419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28794a6001374d62b939a2570f47ef54', 'request_id': 'req-09cae323-4e56-4a20-af4a-3285a7526bbd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:18.887341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 913/1802] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:18.891587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:18.894056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] The token cache is being invalidate because project 28794a6001374d62b939a2570f47ef54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:18.894570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:18.896244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-09cae323-4e56-4a20-af4a-3285a7526bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:18.899756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 890/1803] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:18 2022] DELETE /identity/v3/projects/28794a6001374d62b939a2570f47ef54 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:18.908072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45472b6-00f2-49e3-b874-03b1654992a5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:18.908833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45472b6-00f2-49e3-b874-03b1654992a5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:18.909623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45472b6-00f2-49e3-b874-03b1654992a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:18.932806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f899-88c0-4d49-b620-9bfbdfb1cbdb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:18.981574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f45472b6-00f2-49e3-b874-03b1654992a5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:18.983736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f45472b6-00f2-49e3-b874-03b1654992a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:19.168267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.169813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.171402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.172531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] PATH_INFO: `/v3/projects/9a5a4b99503445bc98410e8f8bade660/users/1abb41ae90b7428fb233636b98df1ca5/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.222459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a4b99503445bc98410e8f8bade660, user_id=1abb41ae90b7428fb233636b98df1ca5, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.230158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec896970-2179-4b9a-9613-af39e195e4b5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:19.256551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 891/1804] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:19.263185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.263497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.263773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.285544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 914/1805] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:18 2022] PUT /identity/v3/projects/9a5a4b99503445bc98410e8f8bade660/users/1abb41ae90b7428fb233636b98df1ca5/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:19.292452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.292786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.293379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.365121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:19.366448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:19.411476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] MFA Rules not processed for user `1abb41ae90b7428fb233636b98df1ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:19.417014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:19.591309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 892/1806] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:19.596299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:19.606982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb24fe-45f4-42f2-aee9-b2e309111021 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:19.613184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.614005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.614367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.614720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.615590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:19.615970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.617806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:19.631643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 893/1807] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:58:19.648048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:19.651543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 915/1808] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:19.655627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:19.657513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:19.681537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f760e-9be5-49ac-b554-029ee887c479 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:19.688840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1a102-378d-4d9b-8c06-6f735aec9586 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:19.703380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.704886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.705333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.705805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.706734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.709982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.713968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:19.728593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.733264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.736015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.741603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.747013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:19.782668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 916/1809] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:19.784878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:19.845589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 894/1810] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/projects => generated 399 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:19.850451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:19.943023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c277-03f7-4619-abca-51e919325510 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:19.950001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.951487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.952163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.952273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.953344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.956329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:19.961293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edb8f-3425-4039-bf9c-58738e85a6e6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:19.972629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:19.974082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:19.974402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:19.974680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:19.975423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:19.977461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.001950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 895/1811] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:20.008380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.034013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 917/1812] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:19 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:20.035291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.053598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f9a-ff9c-403f-902b-4cdeaf639a2c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.063426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d581-9aa3-4717-b66e-3c4f7b21b1a6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.068742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.069425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.069739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.070012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.070392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.070740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.071079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.071375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.071675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.072575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.073107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.076793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.092735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 918/1813] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:20.101308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.111669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 896/1814] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:20.112506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2918f-9af7-41ad-83a3-50d45e19c65e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.113785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.118039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.118931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.120720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.120948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] PATH_INFO: `/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5/users/b55de9ddd46a477d841893a3815b992d/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.138472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15df94-6cf1-472f-b2e1-2c77e6b9a2bf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.150145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60bfcb178f6435da1e0f2fe2eef8bf5, user_id=b55de9ddd46a477d841893a3815b992d, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.152869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.153305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.154050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.154345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.154633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.155376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.158923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.184249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 897/1815] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:58:20.187692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 919/1816] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:20 2022] PUT /identity/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5/users/b55de9ddd46a477d841893a3815b992d/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:20.189270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.193879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.218640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1390d5-6fe3-4727-a458-737d6f35fbb8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.351946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acd30-5b40-4cf9-91b5-56959aa52a80 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.363940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.365995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.366532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.367228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.389336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.392413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.396023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.396023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.396209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] PATH_INFO: `/v3/projects/a36fe9f5bb724e6db53b45dced2f3f50/users/3dc9476ffc134f94b08c16d670892046/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.397493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.435038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36fe9f5bb724e6db53b45dced2f3f50, user_id=3dc9476ffc134f94b08c16d670892046, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.443103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 920/1817] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:20.443299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.444190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.446308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:20.470511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 898/1818] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:20 2022] PUT /identity/v3/projects/a36fe9f5bb724e6db53b45dced2f3f50/users/3dc9476ffc134f94b08c16d670892046/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:20.471508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:20.472433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee747-ab5e-41b0-ae8e-44d68229afde admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.621174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8fcab-81cc-4e45-9418-653936b6b4a3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:20.635486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.643262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.646147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.646651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] PATH_INFO: `/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5/users/b55de9ddd46a477d841893a3815b992d/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.654549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60bfcb178f6435da1e0f2fe2eef8bf5, user_id=b55de9ddd46a477d841893a3815b992d, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.658478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:20.659391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.659683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.660093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2297a7-04da-49b9-b98f-6139876a8576 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.660196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] PATH_INFO: `/v3/users/7a1de7ad37d3481da215f58c8eb3991c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.661617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1de7ad37d3481da215f58c8eb3991c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:20.663733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:20.687525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 899/1819] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:20 2022] PUT /identity/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5/users/b55de9ddd46a477d841893a3815b992d/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:20.694106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91cd1-5735-4b20-9c56-98006745e242 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.695465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91cd1-5735-4b20-9c56-98006745e242 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.695945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91cd1-5735-4b20-9c56-98006745e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.752928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3de91cd1-5735-4b20-9c56-98006745e242 None None] MFA Rules not processed for user `3dc9476ffc134f94b08c16d670892046`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:20.758689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3de91cd1-5735-4b20-9c56-98006745e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:20.786277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1de7ad37d3481da215f58c8eb3991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:20.801321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1de7ad37d3481da215f58c8eb3991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:20.802391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1de7ad37d3481da215f58c8eb3991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:20.803381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1de7ad37d3481da215f58c8eb3991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:20.818713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f52fec22-2e8a-4e11-9100-36b19ed30ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1de7ad37d3481da215f58c8eb3991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:20.843362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 921/1820] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:20 2022] DELETE /identity/v3/users/7a1de7ad37d3481da215f58c8eb3991c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:20.845615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.846017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.847127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.875009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 900/1821] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:20.876923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:20.879482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:20.880165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:20.911346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] MFA Rules not processed for user `b55de9ddd46a477d841893a3815b992d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:20.913381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:20.920326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:20.921954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:21.025511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 922/1822] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:21.025511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.033957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:21.040872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 901/1823] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:21.044414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.046314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:21.056945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff6cf-16ac-473d-a701-31462abc17a4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.075467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.076169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.076459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.077256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.077510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.080156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.157266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 923/1824] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:21 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:21.164218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.167142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:21.254711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceb669-0aa6-4062-ba13-bc4c75e6117d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.338442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700a5b2-0ade-44eb-9c95-4025aa2177e5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.346421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.347140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.347428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.347752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.356029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.356720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.357010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.357330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.465621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.467213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.495250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.496923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.502457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 902/1825] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:21.503432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.519407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc528c-964b-44b3-8343-971796772075 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.522492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 924/1826] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:21.527048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.527736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.528028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.528307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.529088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.531241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.570566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 903/1827] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:21 2022] POST /identity/v3/users => generated 306 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:21.571688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.596878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41817-8abb-4633-81a3-e034192861aa service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.621231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.621955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.622251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.622531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.623261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.624952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.650659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 925/1828] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:21.654951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.674629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51652-de57-4452-aacd-e8d54258eb10 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.684583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.686054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.686483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.686929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] PATH_INFO: `/v3/projects/e604dc03fb854cd6be4239370afbd04d/users/ba5db564c8564e36b747606ae29e26c1/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.708158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e604dc03fb854cd6be4239370afbd04d, user_id=ba5db564c8564e36b747606ae29e26c1, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.712071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.731802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 904/1829] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:21 2022] PUT /identity/v3/projects/e604dc03fb854cd6be4239370afbd04d/users/ba5db564c8564e36b747606ae29e26c1/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:21.735799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.751252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfffff4-6807-463e-8f03-a206367143b8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.873727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.874909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.875401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.875876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.876647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.878710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b8295-cc96-473b-bcfd-0d98801daf7a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.899304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:21.901823 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 926/1830] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:21.917710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613048eb-903a-4ba1-96a1-3182f4ea5b6a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:21.928099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:21.931042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.931547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.932001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] PATH_INFO: `/v3/projects/e604dc03fb854cd6be4239370afbd04d/users/ba5db564c8564e36b747606ae29e26c1/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:21.934969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e604dc03fb854cd6be4239370afbd04d, user_id=ba5db564c8564e36b747606ae29e26c1, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:21.939926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:21.971211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 905/1831] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:21 2022] PUT /identity/v3/projects/e604dc03fb854cd6be4239370afbd04d/users/ba5db564c8564e36b747606ae29e26c1/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:21.981424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:21.982026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:21.982307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:22.044772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] MFA Rules not processed for user `ba5db564c8564e36b747606ae29e26c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:22.051442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:22.302089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 927/1832] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:22.313393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:22.443842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6f21-61e9-4c1d-89e0-db8b23c8ccb7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:22.450512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:22.455323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:22.475619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:22.476662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:22.502254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:22.505786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:22.548607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 906/1833] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:22.588095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:22.590085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:22.618826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1919c-96ca-483a-91bd-737fc37c5490 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:22.632287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:22.633247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:22.633728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:22.634143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:22.640516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:22.737790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:22.739537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d2ab-77cf-499f-82cf-c2b585b310cb service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:22.761840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 928/1834] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:22.791586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:22.803260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b851b-b519-45ee-9b8f-552d2390678d service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:22.818135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:22.818814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:22.819091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:22.819527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:22.966996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:22.968473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eb915-a263-42f6-9ed6-dbefe388496b service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:22.996272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 907/1835] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:23.551163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:23.551804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:23.552413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:23.554763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 929/1836] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:58:23.572188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:23.572489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:23.572766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:23.617387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:23.620570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:23.764661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:23.767583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:23.910331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc75a47-40dd-40bd-a165-f9172dcc1dd5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:23.916111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:23.917253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:23.917761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:23.918390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] PATH_INFO: `/v3/projects/2d88dd4f26c44f4f95eb517b822ee511` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:23.919885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d88dd4f26c44f4f95eb517b822ee511)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:23.922521 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:23.932415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 908/1837] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:58:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:23.977952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d88dd4f26c44f4f95eb517b822ee511', 'request_id': 'req-4ab07ab7-6454-49f1-ad72-10d4238baf05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:23.984560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d88dd4f26c44f4f95eb517b822ee511', 'request_id': 'req-4ab07ab7-6454-49f1-ad72-10d4238baf05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:23.996529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d88dd4f26c44f4f95eb517b822ee511', 'request_id': 'req-4ab07ab7-6454-49f1-ad72-10d4238baf05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.014326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] The token cache is being invalidate because project 2d88dd4f26c44f4f95eb517b822ee511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:24.015239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.018819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.020464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 930/1838] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:23 2022] DELETE /identity/v3/projects/2d88dd4f26c44f4f95eb517b822ee511 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:24.030144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:24.045162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1300-8641-433b-9f39-2b9dff7b2040 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:24.053583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:24.055526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:24.217300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:24.222606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:24.223112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:24.223519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] PATH_INFO: `/v3/users/acd09289a87e4a75a6537643a8266ac1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:24.225278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd09289a87e4a75a6537643a8266ac1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:24.227406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:24.230074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07ab7-6454-49f1-ad72-10d4238baf05 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:24.239361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:24.240035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:24.240319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:24.240819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:24.244003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:24.288971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:24.290974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825aac1-4d65-4231-a88f-91ce08392688 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:24.314922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 931/1839] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:58:24.346035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd09289a87e4a75a6537643a8266ac1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.388271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd09289a87e4a75a6537643a8266ac1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.408261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd09289a87e4a75a6537643a8266ac1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.415867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd09289a87e4a75a6537643a8266ac1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.417497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cc4490e-dcf5-48a4-b087-961581b6ccf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd09289a87e4a75a6537643a8266ac1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:24.459826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 909/1840] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:24 2022] DELETE /identity/v3/users/acd09289a87e4a75a6537643a8266ac1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:24.642093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:24.642605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:24.643128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:24.645373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 932/1841] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 05:58:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 05:58:24.800249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91b81-a2b3-4a5d-acce-2dde9bbe01e0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:24.801162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91b81-a2b3-4a5d-acce-2dde9bbe01e0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:24.801686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91b81-a2b3-4a5d-acce-2dde9bbe01e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:24.875803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d1a91b81-a2b3-4a5d-acce-2dde9bbe01e0 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:24.877318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d1a91b81-a2b3-4a5d-acce-2dde9bbe01e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:25.028168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 910/1842] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 05:58:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:25.731340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:25.733632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:25.760323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b9a4-f5fc-443d-b0db-508b01f22140 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:25.768115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:25.769343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:25.770002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:25.770465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:25.782819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:25.792124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:25.822766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 933/1843] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:25.846727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:25.847248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:25.847694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:25.870513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] MFA Rules not processed for user `aa2d83bcc02a43f89ba4785a9bdedd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:25.872495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:25.976451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 911/1844] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:26.239144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:26.240690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:26.395126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10bf42-e89d-4e7d-9b95-e8980149e7d3 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:26.408178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:26.409364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:26.410080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:26.410740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] PATH_INFO: `/v3/projects/40c7d054df6644c6a589f18d7c04d78d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:26.412323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c7d054df6644c6a589f18d7c04d78d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:26.414595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:26.478068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c7d054df6644c6a589f18d7c04d78d', 'request_id': 'req-b347d403-78dd-4a54-8a5b-14d6d216991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.484280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c7d054df6644c6a589f18d7c04d78d', 'request_id': 'req-b347d403-78dd-4a54-8a5b-14d6d216991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.495551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c7d054df6644c6a589f18d7c04d78d', 'request_id': 'req-b347d403-78dd-4a54-8a5b-14d6d216991c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.522702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] The token cache is being invalidate because project 40c7d054df6644c6a589f18d7c04d78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:26.523331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.524272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.528122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 934/1845] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:26 2022] DELETE /identity/v3/projects/40c7d054df6644c6a589f18d7c04d78d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:26.533081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:26.546708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bed8-9577-4572-ab15-3e6cb79785fe None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:26.646756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:26.647705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:26.648051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:26.649082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] PATH_INFO: `/v3/users/9cfc096ef8764eac8345a4513486eacb` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:26.650107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfc096ef8764eac8345a4513486eacb)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:26.652366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:26.766821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfc096ef8764eac8345a4513486eacb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.785532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfc096ef8764eac8345a4513486eacb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.795514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfc096ef8764eac8345a4513486eacb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.797188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfc096ef8764eac8345a4513486eacb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.797816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c63b134-c033-40c2-bb81-8ee89c095e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfc096ef8764eac8345a4513486eacb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:26.817214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 912/1846] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:26 2022] DELETE /identity/v3/users/9cfc096ef8764eac8345a4513486eacb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:27.395590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:27.397607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:27.426750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347d403-78dd-4a54-8a5b-14d6d216991c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:27.588807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:27.590622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:27.591087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:27.592445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] PATH_INFO: `/v3/projects/6fd02527260140a590e6da7b1e2af725` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:27.595662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd02527260140a590e6da7b1e2af725)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:27.598363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:27.697375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd02527260140a590e6da7b1e2af725', 'request_id': 'req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:27.718230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd02527260140a590e6da7b1e2af725', 'request_id': 'req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:27.737225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd02527260140a590e6da7b1e2af725', 'request_id': 'req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:27.759508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] The token cache is being invalidate because project 6fd02527260140a590e6da7b1e2af725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:27.760004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:27.760948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:27.767361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 935/1847] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:27 2022] DELETE /identity/v3/projects/6fd02527260140a590e6da7b1e2af725 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:27.774430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caed5c-f718-47fa-902c-c79b0c02a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:27.774969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caed5c-f718-47fa-902c-c79b0c02a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:27.775058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caed5c-f718-47fa-902c-c79b0c02a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:27.814509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-37caed5c-f718-47fa-902c-c79b0c02a1e6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:27.818203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-37caed5c-f718-47fa-902c-c79b0c02a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:27.827319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:27.830038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:27.973631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb06f5-85a0-4b0b-bacc-d6a828bfc491 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:27.990457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:27.990457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:27.990865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 913/1848] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:27.990954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:27.990954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:27.990954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:27.992130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:27.992423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:27.992705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.056945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:28.063340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:28.086545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 914/1849] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:28.088447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.094379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:28.124583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbcadf-fa0d-467f-b6c6-4b896e75b26a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.130877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.132035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.132553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.133187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] PATH_INFO: `/v3/users/3dc9476ffc134f94b08c16d670892046` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.134593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc9476ffc134f94b08c16d670892046)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.136766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.143225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.146382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.169222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 936/1850] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:28.170318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.207096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664ec9-d145-49b3-a7be-176b3a8f125c service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.212649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.213438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.214065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.214363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.215106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:28.216037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.217833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.218418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc9476ffc134f94b08c16d670892046'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:28.237046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 937/1851] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:28.238240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.254025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4916-c432-4091-b8bc-50c4793579ad admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.268803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.269727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.270023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.270312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.271029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.273409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.294694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc9476ffc134f94b08c16d670892046'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:28.306244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 938/1852] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:28 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:28.311221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.325035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc9476ffc134f94b08c16d670892046'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:28.325952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc9476ffc134f94b08c16d670892046'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:28.326766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5d719973-95b6-4646-9f2d-86dc64e8bd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc9476ffc134f94b08c16d670892046'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:28.352181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 915/1853] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:28 2022] DELETE /identity/v3/users/3dc9476ffc134f94b08c16d670892046 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:28.357755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.358350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.360654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.404931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:28.406119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:28.479849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d098-fe83-4122-81e1-b61511910134 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.532558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 916/1854] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:28.583147 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.584489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.584880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.585265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.586416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.588987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.619695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 939/1855] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:28 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:28.624003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.626234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:28.642575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c1264-cd35-454e-a86a-18078b1290ff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.649463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.652107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.652650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.653203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.654453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.654796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.656820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:28.657134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.686376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 917/1856] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:28.687942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.719577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e98a-a544-449b-b34f-d03596e23053 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.739657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.741331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.743811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.744397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.747448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.753834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.779332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 918/1857] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:28.783835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:28.815628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d565-e4c8-4ae7-880f-ef0ea595c6f1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.816726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e8ea-cf27-4033-b9b0-3f1c8bf4e584 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:28.823907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.825781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.827826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.828533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.832792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:28.833733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.834021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.835100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] PATH_INFO: `/v3/projects/4285af910bec40c4a5a5691d5492f941/users/9f19dad38bba4adb9267a1fcbc26d7b2/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.843716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.847108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe5a2b-e036-4499-bd05-8f24280cf120 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.864090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 940/1858] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:28.877195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4285af910bec40c4a5a5691d5492f941, user_id=9f19dad38bba4adb9267a1fcbc26d7b2, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:28.880475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:28.900775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 919/1859] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:28 2022] PUT /identity/v3/projects/4285af910bec40c4a5a5691d5492f941/users/9f19dad38bba4adb9267a1fcbc26d7b2/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:28.906113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:28.907855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:28.908242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:28.947927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:28.949588 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:29.105773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 941/1860] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:29.125544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:29.127735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:29.252330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2372075-32d3-4c49-91ac-f7d65f08dde9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:29.256931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:29.258159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:29.258566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:29.258949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:29.274129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:29.276144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:29.293540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 920/1861] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:29.713208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:29.716533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:29.738408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b18500-54ce-49be-a481-ac2c8111d9a9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:29.746739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:29.747968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:29.748457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:29.757370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] PATH_INFO: `/v3/projects/a36fe9f5bb724e6db53b45dced2f3f50` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:29.759237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36fe9f5bb724e6db53b45dced2f3f50)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:29.763001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:29.856461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36fe9f5bb724e6db53b45dced2f3f50', 'request_id': 'req-285e0e62-54c4-475b-a81f-5fe149b848ae'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:29.871953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36fe9f5bb724e6db53b45dced2f3f50', 'request_id': 'req-285e0e62-54c4-475b-a81f-5fe149b848ae'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:29.892871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36fe9f5bb724e6db53b45dced2f3f50', 'request_id': 'req-285e0e62-54c4-475b-a81f-5fe149b848ae'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:29.908691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] The token cache is being invalidate because project a36fe9f5bb724e6db53b45dced2f3f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:29.909694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:29.911029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:29.915095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 942/1862] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:29 2022] DELETE /identity/v3/projects/a36fe9f5bb724e6db53b45dced2f3f50 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:29.919656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:29.933529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd934c-ebd9-4fa2-b79f-a5e0f54c70ad service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:30.019229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:30.020442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:30.020932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:30.021455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] PATH_INFO: `/v3/users/ba5db564c8564e36b747606ae29e26c1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:30.023369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5db564c8564e36b747606ae29e26c1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:30.026820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:30.097246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5db564c8564e36b747606ae29e26c1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.114053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5db564c8564e36b747606ae29e26c1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.122555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5db564c8564e36b747606ae29e26c1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.123450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5db564c8564e36b747606ae29e26c1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.124130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8119a276-1554-483f-9a6f-1ab09921b568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5db564c8564e36b747606ae29e26c1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.144059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 921/1863] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:29 2022] DELETE /identity/v3/users/ba5db564c8564e36b747606ae29e26c1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:30.510640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:30.512990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:30.542541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e62-54c4-475b-a81f-5fe149b848ae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:30.680668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:30.681578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:30.681876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:30.683491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] PATH_INFO: `/v3/projects/e604dc03fb854cd6be4239370afbd04d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:30.686564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e604dc03fb854cd6be4239370afbd04d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:30.689288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:30.818101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e604dc03fb854cd6be4239370afbd04d', 'request_id': 'req-ca054b74-9014-472b-ad35-a78988901ff0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.834294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e604dc03fb854cd6be4239370afbd04d', 'request_id': 'req-ca054b74-9014-472b-ad35-a78988901ff0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.847615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e604dc03fb854cd6be4239370afbd04d', 'request_id': 'req-ca054b74-9014-472b-ad35-a78988901ff0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.880130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] The token cache is being invalidate because project e604dc03fb854cd6be4239370afbd04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:30.881722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.883672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca054b74-9014-472b-ad35-a78988901ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:30.889581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 943/1864] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:30 2022] DELETE /identity/v3/projects/e604dc03fb854cd6be4239370afbd04d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:30.895266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:30.895595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:30.896056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:30.930661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:30.932570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.118319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 922/1865] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:31.119193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.119619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.121920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.180240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:31.180577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.182103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.192334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.201739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39896da-41d7-4df0-9975-73785e02f971 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.215963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 944/1866] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:31.215963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.225966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.226870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.227157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.227436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] PATH_INFO: `/v3/users/0efaa389113f4c35a70a9a0a32ec0269` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.234163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efaa389113f4c35a70a9a0a32ec0269)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.236426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.248435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa841-2c37-4a83-b094-80a225520de0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.269930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.273152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.274107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.275354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.276310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:31.278247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.284283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.325594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 945/1867] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:31.330193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.363748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34fd75-a759-47ec-b8f6-83262a7ca365 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.380984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efaa389113f4c35a70a9a0a32ec0269'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:31.397600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.399757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.400159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.400522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.401480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.403757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.430574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efaa389113f4c35a70a9a0a32ec0269'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:31.439123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efaa389113f4c35a70a9a0a32ec0269'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:31.439875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efaa389113f4c35a70a9a0a32ec0269'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:31.440680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5fca9dc6-1870-4a97-a35f-4d98fc8c0667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efaa389113f4c35a70a9a0a32ec0269'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:31.473573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 946/1868] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:31 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:31.478033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 923/1869] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:31 2022] DELETE /identity/v3/users/0efaa389113f4c35a70a9a0a32ec0269 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:31.481100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.482709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.483198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.483660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.483762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.526721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:31.528328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.607900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273b26-d6ad-4232-b35c-1ab2a2e35874 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.628185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 924/1870] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:31.643609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.645354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:31.692406 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.696761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.698204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.698596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.699529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.701693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.733566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 947/1871] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:31 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:31.736882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.757068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d8ba2-c675-41e0-8397-94120f84cfe1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.764305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecc29-0d1d-424b-b417-19222d3a7306 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.767329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.768100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.768524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.768838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.775670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.777219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.777956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.778637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.780438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.783531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.793851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.795676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.804806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 948/1872] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:31.811733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.825387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 925/1873] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:31.830375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53cda-1482-4fe4-b06a-f2ba4e39d82f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.836042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.836972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.837514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.838032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.839357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.841171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fab53-568a-40f9-b737-804ca6f01131 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.860078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:31.861437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 949/1874] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:31.870874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce6fa4-b172-43cb-a846-41f398fa6798 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:31.899764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:31.900839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.901569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.902664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] PATH_INFO: `/v3/projects/0f35e4af32284885a5abd4f09b0d2bb7/users/e93b10173c094a09824f11fa51dc7561/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.929256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f35e4af32284885a5abd4f09b0d2bb7, user_id=e93b10173c094a09824f11fa51dc7561, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:31.932850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:31.962155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 926/1875] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:31 2022] PUT /identity/v3/projects/0f35e4af32284885a5abd4f09b0d2bb7/users/e93b10173c094a09824f11fa51dc7561/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:31.964591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:31.964926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:31.965208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:31.998082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] MFA Rules not processed for user `e93b10173c094a09824f11fa51dc7561`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:31.999325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:32.090492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 950/1876] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:32.095067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.178538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5396f8-bf00-454b-8a66-e0ef5770a841 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.183868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.184653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.184935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.185732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.186107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.188723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.232671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 927/1877] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:32 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:32.236369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.271722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b582b61-c03c-4eb0-85b9-7c2d57e389e2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.371408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.372194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.373800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.374163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.375062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.377145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.416191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 951/1878] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:32 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:32.417646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.436346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378932ec-c612-4034-82f9-9306cddc6c35 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.455702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.464493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.465877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.466244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.467081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.469200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.489720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.490494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 928/1879] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:32.507814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.512144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:32.527855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a494-3642-497e-9cc3-e2ae456d5630 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.535538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.536743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.536934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.537194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] PATH_INFO: `/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c/users/639b206952d5406ea7962ef48ebb6645/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.555074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a383-21db-4631-9790-17cac5a41234 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.561257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] RBAC: Authorizing `identity:create_grant(project_id=022300e9ff1243c3ad4a1c5ced34f49c, user_id=639b206952d5406ea7962ef48ebb6645, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.564850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.574344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.579412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.580058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.580508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] PATH_INFO: `/v3/projects/239d158ff0bc4d2493e5b30737fa35b3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.590263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 952/1880] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:32 2022] PUT /identity/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c/users/639b206952d5406ea7962ef48ebb6645/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:32.597085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.608169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239d158ff0bc4d2493e5b30737fa35b3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.612090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.740309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239d158ff0bc4d2493e5b30737fa35b3', 'request_id': 'req-3c9a17c8-f6c8-43a7-819a-162f40f0c934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:32.755112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239d158ff0bc4d2493e5b30737fa35b3', 'request_id': 'req-3c9a17c8-f6c8-43a7-819a-162f40f0c934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:32.769782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239d158ff0bc4d2493e5b30737fa35b3', 'request_id': 'req-3c9a17c8-f6c8-43a7-819a-162f40f0c934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:32.788316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a65f-59a5-4d49-bbc8-b18c3362289f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.793427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] The token cache is being invalidate because project 239d158ff0bc4d2493e5b30737fa35b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:32.793884 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:32.796135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:32.800940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 929/1881] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:32 2022] DELETE /identity/v3/projects/239d158ff0bc4d2493e5b30737fa35b3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:32.802204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.806782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:32.892037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.893216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.893216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.893440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.894452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.896457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.912157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 953/1882] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:32.918301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:32.920215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:32.942952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0812d0-4592-465e-a1d2-ccae698b896e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.949495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.951140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.952217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.952850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] PATH_INFO: `/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c/users/639b206952d5406ea7962ef48ebb6645/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.957249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=022300e9ff1243c3ad4a1c5ced34f49c, user_id=639b206952d5406ea7962ef48ebb6645, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.958464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a17c8-f6c8-43a7-819a-162f40f0c934 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:32.963050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828c378-9e82-4a1c-8655-599283e8b72d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.971885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:32.973051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.973529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.973963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] PATH_INFO: `/v3/users/1abb41ae90b7428fb233636b98df1ca5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:32.983467 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abb41ae90b7428fb233636b98df1ca5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:32.985878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:32.993992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 954/1883] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:32 2022] PUT /identity/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c/users/639b206952d5406ea7962ef48ebb6645/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:32.995694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:32.996087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:32.996472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:33.061636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abb41ae90b7428fb233636b98df1ca5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:33.075010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abb41ae90b7428fb233636b98df1ca5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:33.079416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] MFA Rules not processed for user `639b206952d5406ea7962ef48ebb6645`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:33.080658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:33.083745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abb41ae90b7428fb233636b98df1ca5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:33.085443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abb41ae90b7428fb233636b98df1ca5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:33.087817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abb41ae90b7428fb233636b98df1ca5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:33.106727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 930/1884] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:32 2022] DELETE /identity/v3/users/1abb41ae90b7428fb233636b98df1ca5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:33.282308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 955/1885] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:33.295457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:33.298485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:33.426105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ccd5-5c0c-4574-94a6-13e96f7e44ad admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:33.433041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:33.434204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:33.434592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:33.435348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:33.521373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:33.523189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:33.552177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 931/1886] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:33.705967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:33.807880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021782-1fa9-4b9b-9c0e-a169dac9be23 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:33.818061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:33.819395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:33.819845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:33.820280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:33.822968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:33.945628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:33.947839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:33.958867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 956/1887] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:34.970732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:34.972318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:35.058927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7412e-b568-419f-9fe3-10059ce2d304 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:35.095548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:35.096444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:35.096727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:35.097007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] PATH_INFO: `/v3/projects/9a5a4b99503445bc98410e8f8bade660` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:35.102230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5a4b99503445bc98410e8f8bade660)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:35.104169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:35.212151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5a4b99503445bc98410e8f8bade660', 'request_id': 'req-049f3292-30ae-4319-a9e5-2081da4646fc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.218226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5a4b99503445bc98410e8f8bade660', 'request_id': 'req-049f3292-30ae-4319-a9e5-2081da4646fc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.225115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5a4b99503445bc98410e8f8bade660', 'request_id': 'req-049f3292-30ae-4319-a9e5-2081da4646fc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.244037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] The token cache is being invalidate because project 9a5a4b99503445bc98410e8f8bade660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:35.245214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.246016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.251289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 932/1888] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:34 2022] DELETE /identity/v3/projects/9a5a4b99503445bc98410e8f8bade660 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:35.252499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:35.267278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9aec-2ea0-41f4-a005-10fea4ec27da service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:35.356984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:35.360562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:35.361123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:35.361657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] PATH_INFO: `/v3/users/b55de9ddd46a477d841893a3815b992d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:35.364322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55de9ddd46a477d841893a3815b992d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:35.366427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:35.430131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55de9ddd46a477d841893a3815b992d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.444900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55de9ddd46a477d841893a3815b992d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.446212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55de9ddd46a477d841893a3815b992d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.447285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55de9ddd46a477d841893a3815b992d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.458900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c2b9a69f-4de0-4da6-9420-320ce28318a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55de9ddd46a477d841893a3815b992d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:35.479309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 957/1889] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:35 2022] DELETE /identity/v3/users/b55de9ddd46a477d841893a3815b992d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:36.381082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:36.382973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:36.401862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3292-30ae-4319-a9e5-2081da4646fc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:36.543797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:36.544945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:36.545383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:36.545872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] PATH_INFO: `/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:36.548486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60bfcb178f6435da1e0f2fe2eef8bf5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:36.550675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:36.643630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60bfcb178f6435da1e0f2fe2eef8bf5', 'request_id': 'req-56e8f92f-b221-4b85-8470-eefad4269ff7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:36.651422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60bfcb178f6435da1e0f2fe2eef8bf5', 'request_id': 'req-56e8f92f-b221-4b85-8470-eefad4269ff7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:36.660209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60bfcb178f6435da1e0f2fe2eef8bf5', 'request_id': 'req-56e8f92f-b221-4b85-8470-eefad4269ff7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:36.688124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] The token cache is being invalidate because project f60bfcb178f6435da1e0f2fe2eef8bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:36.689238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:36.691412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56e8f92f-b221-4b85-8470-eefad4269ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:36.696343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 933/1890] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:36 2022] DELETE /identity/v3/projects/f60bfcb178f6435da1e0f2fe2eef8bf5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:36.703390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:36.704003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:36.704003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:36.729450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:36.731118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:36.820886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:36.821342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:36.821815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:36.834452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 958/1891] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:36.852594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:36.854360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:36.883473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 934/1892] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:36.887779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:36.912350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29cd5-57f0-49b9-bef7-3ba071371500 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:36.934011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:36.934700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:36.934983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:36.935259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:36.935995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:36.936301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:36.939628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:36.962478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 959/1893] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:36.962960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:36.979119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e140ee0-86d4-4d70-844b-07f61d94ff4f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:36.987813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:36.990767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:36.991137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:36.991496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:36.992929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:36.996627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.052134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 935/1894] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:36 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:37.056312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.084617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138af2a9-44fa-4622-9bcb-e82c4c0edd2e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.270930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.272090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.272537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.273343 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.274437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.276553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.306800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 960/1895] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:37 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:37.310991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.322524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4b92-c342-4d3d-b0c0-d4ad1f604b37 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.338463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.341161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:37.349401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.350336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.350636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.350921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.351677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.353281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.355870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc514f-6234-4987-a369-a537f3b3fcd2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.362265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.363263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.363546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.363822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] PATH_INFO: `/v3/users/e93b10173c094a09824f11fa51dc7561` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.365612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93b10173c094a09824f11fa51dc7561)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.367126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.382743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 936/1896] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:58:37.386892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.398370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefd682-7800-4979-be3d-cb5fea8115c9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.409818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.411038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.411675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.411962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.415136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.416729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.434990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 937/1897] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:37.436006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.448686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deebe9-5b1a-4b00-80e0-f4e6c0de6c7e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.457673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.458664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.459164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.459536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] PATH_INFO: `/v3/projects/c6f76455aca1484ba8c2b80b4c7881ef/users/9cc06ee5bbe64c82b8b98001e9fc31fe/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.462743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93b10173c094a09824f11fa51dc7561'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:37.483477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f76455aca1484ba8c2b80b4c7881ef, user_id=9cc06ee5bbe64c82b8b98001e9fc31fe, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.486831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93b10173c094a09824f11fa51dc7561'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:37.488561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be10c05-ecf1-484a-8bab-b8c3730eeef2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.488895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93b10173c094a09824f11fa51dc7561'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:37.490030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93b10173c094a09824f11fa51dc7561'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:37.504245 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5dcd4b6c-7b82-41c3-b343-e4d9c827a3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93b10173c094a09824f11fa51dc7561'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:37.514449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 938/1898] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:37 2022] PUT /identity/v3/projects/c6f76455aca1484ba8c2b80b4c7881ef/users/9cc06ee5bbe64c82b8b98001e9fc31fe/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:37.520694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 961/1899] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:37 2022] DELETE /identity/v3/users/e93b10173c094a09824f11fa51dc7561 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:37.525115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.525603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.525899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.530409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.530409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.530656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.569952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:37.571611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:37.575564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] MFA Rules not processed for user `9cc06ee5bbe64c82b8b98001e9fc31fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:37.580259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:37.723723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 939/1900] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:37.739708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.743885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:37.794990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 962/1901] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:37.797044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.802842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:37.817119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c844f6-3b50-4a99-be2f-f9025ed8cef1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.822898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.823817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.824259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.824687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.825648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.828700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.848323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bf259-e2bf-48b1-be39-d8a88e7dcd27 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:37.852880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:37.854695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:37.855261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:37.855737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:37.875103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:37.879868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:37.888903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 963/1902] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:37 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:37.890180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:37.907182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 940/1903] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:37.993643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db0af-ca8d-4757-93de-1edde9cfe10d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.007118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.008103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.008555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.009328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.010220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.012522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.058701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 964/1904] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:37 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:38.064834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:38.081151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7dfd6-0148-4e3b-95c8-3ab28b18a8ef service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.087294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.088309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.088909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.089411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.090460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.092411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.118531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 941/1905] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:38.122826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:38.137964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9de82-1ea0-4611-ad39-8716b9784957 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.147967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.149054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.149439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.149859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] PATH_INFO: `/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b/users/d956b0763fe94f598bf8d1dc1e96bc74/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.179088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfed9c8c4fab43e6b7c43f5df09f601b, user_id=d956b0763fe94f598bf8d1dc1e96bc74, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.186149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.209582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 965/1906] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:38 2022] PUT /identity/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b/users/d956b0763fe94f598bf8d1dc1e96bc74/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:38.210873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:38.223636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790b07-14b5-44af-9732-4f0b10b51691 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.318739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.320020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.320020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.320312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.321224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.324213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b9eb-3641-46d5-abbb-f41e36e5be8f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.361317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 942/1907] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:38.365282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:38.379901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299992-568d-4b97-ad5f-c26ab079fd6f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.392783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.393829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.394132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.394599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] PATH_INFO: `/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b/users/d956b0763fe94f598bf8d1dc1e96bc74/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.398161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfed9c8c4fab43e6b7c43f5df09f601b, user_id=d956b0763fe94f598bf8d1dc1e96bc74, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.402011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.426793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.427377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 966/1908] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:38 2022] PUT /identity/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b/users/d956b0763fe94f598bf8d1dc1e96bc74/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:38.427824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.428249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.476442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] MFA Rules not processed for user `d956b0763fe94f598bf8d1dc1e96bc74`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:38.478827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:38.633824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 943/1909] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:38.652019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:38.660259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:38.825396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab186c22-1343-454e-8668-19d451d466fa admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:38.838834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:38.839709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:38.840003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:38.840428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:38.856553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:38.859323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749a27-5a39-4c00-9281-e443b2c81d43 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:38.875447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 967/1910] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:39.056322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:39.171296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1e4c0-18b3-4767-a7a3-20570af64303 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:39.183957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:39.184867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:39.185178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:39.185465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] PATH_INFO: `/v3/users/9cc06ee5bbe64c82b8b98001e9fc31fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:39.186778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc06ee5bbe64c82b8b98001e9fc31fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:39.189004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:39.295430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc06ee5bbe64c82b8b98001e9fc31fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.321106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc06ee5bbe64c82b8b98001e9fc31fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.342315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc06ee5bbe64c82b8b98001e9fc31fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.342840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc06ee5bbe64c82b8b98001e9fc31fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.343679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc06ee5bbe64c82b8b98001e9fc31fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.375368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 944/1911] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:39 2022] DELETE /identity/v3/users/9cc06ee5bbe64c82b8b98001e9fc31fe => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:39.379409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:39.379695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:39.379978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:39.402420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:39.404095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:39.516324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 968/1912] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:39.571284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:39.573445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:39.688102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:39.690468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:39.705268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83021-f345-4c9e-982e-ba022318f36c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:39.717222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f464b-18f1-4f44-8708-ec09f583d8e7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:39.717981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:39.720668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:39.720951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:39.721234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:39.734430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:39.736034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:39.736461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:39.736967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] PATH_INFO: `/v3/projects/0f35e4af32284885a5abd4f09b0d2bb7` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:39.741327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f35e4af32284885a5abd4f09b0d2bb7)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:39.746310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:39.755528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:39.761331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:39.806041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 945/1913] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:39.873716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f35e4af32284885a5abd4f09b0d2bb7', 'request_id': 'req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.893222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f35e4af32284885a5abd4f09b0d2bb7', 'request_id': 'req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.910601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f35e4af32284885a5abd4f09b0d2bb7', 'request_id': 'req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.925524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] The token cache is being invalidate because project 0f35e4af32284885a5abd4f09b0d2bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:39.925972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.926965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:39.931618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 969/1914] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:39 2022] DELETE /identity/v3/projects/0f35e4af32284885a5abd4f09b0d2bb7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:39.932523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:39.946049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dcf72-f46c-4858-800e-c76bc946201c service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:40.025666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:40.026638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:40.026929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:40.027385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] PATH_INFO: `/v3/users/639b206952d5406ea7962ef48ebb6645` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:40.028693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=639b206952d5406ea7962ef48ebb6645)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:40.030800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:40.095151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639b206952d5406ea7962ef48ebb6645'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:40.115796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639b206952d5406ea7962ef48ebb6645'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:40.130122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639b206952d5406ea7962ef48ebb6645'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:40.130924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639b206952d5406ea7962ef48ebb6645'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:40.131501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-68165a6f-e5e1-49a6-9bc2-7c2b719f41ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639b206952d5406ea7962ef48ebb6645'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:40.148174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 946/1915] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:39 2022] DELETE /identity/v3/users/639b206952d5406ea7962ef48ebb6645 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:40.907301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:40.909351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:40.931804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:40.932311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:40.932533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:40.948986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ba90-38ec-4b70-bc32-2776e20e3ae2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:40.989427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] MFA Rules not processed for user `9f19dad38bba4adb9267a1fcbc26d7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:40.990850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.030558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.032524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.033366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.033843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] PATH_INFO: `/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.036479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022300e9ff1243c3ad4a1c5ced34f49c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.039649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.084889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 947/1916] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:41.090872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.092733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.125695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022300e9ff1243c3ad4a1c5ced34f49c', 'request_id': 'req-577175c0-d155-486a-93bf-6f45dab0bd13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.130747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f469cd-a19a-42df-b332-c3532d321dc5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.135779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022300e9ff1243c3ad4a1c5ced34f49c', 'request_id': 'req-577175c0-d155-486a-93bf-6f45dab0bd13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.149509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022300e9ff1243c3ad4a1c5ced34f49c', 'request_id': 'req-577175c0-d155-486a-93bf-6f45dab0bd13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.181943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] The token cache is being invalidate because project 022300e9ff1243c3ad4a1c5ced34f49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:41.182239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.182892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-577175c0-d155-486a-93bf-6f45dab0bd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.184671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 970/1917] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:40 2022] DELETE /identity/v3/projects/022300e9ff1243c3ad4a1c5ced34f49c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:41.191916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e870-edbf-428c-91fd-fc0ba2cb12a2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.192193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e870-edbf-428c-91fd-fc0ba2cb12a2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.192473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e870-edbf-428c-91fd-fc0ba2cb12a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.251923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2950e870-edbf-428c-91fd-fc0ba2cb12a2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:41.253311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2950e870-edbf-428c-91fd-fc0ba2cb12a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.270162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.270907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.271202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.271488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.275605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.277587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.338030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 971/1918] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:41.346852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.347162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.347452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.353129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 948/1919] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:41 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:41.360019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.363734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.427440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:41.432451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.524356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a332c7-d776-4d2a-8db4-00a21d6ae4e9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.537131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.538589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.538983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.542171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.543023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.545091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.594915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 949/1920] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:41 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:41.596022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.598236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.602250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 972/1921] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:41.603852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.615280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f9278-041a-450f-839e-f4f4804b91b1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.620755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.621966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.622479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.622980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] PATH_INFO: `/v3/projects/c6f76455aca1484ba8c2b80b4c7881ef` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.624808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f76455aca1484ba8c2b80b4c7881ef)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.625682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9331d5-805a-4300-87e4-3dc33b8d46f7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.627986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.641204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.641603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.641957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.642237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.643260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.645131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.665934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 973/1922] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:41.667658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.682317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51d08-cb7a-4b3a-a773-274bffbd6cf3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.692130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.693058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.693432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.693925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.694673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:41.695084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.696918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.718085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 974/1923] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:41.719618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.743753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839da-cdc6-4cd4-bf60-e5b69744d4e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.804563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f76455aca1484ba8c2b80b4c7881ef', 'request_id': 'req-46b58459-1e98-4a72-893c-19bcb107fd8c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.821191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:41.822418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:41.822908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:41.823231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] PATH_INFO: `/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c/users/f7cbff27a4744479a48fe12845d358d3/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:41.839683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f76455aca1484ba8c2b80b4c7881ef', 'request_id': 'req-46b58459-1e98-4a72-893c-19bcb107fd8c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.859243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ef7b8d8d54a29870bcaf3d128e07c, user_id=f7cbff27a4744479a48fe12845d358d3, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:41.865002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:41.869721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f76455aca1484ba8c2b80b4c7881ef', 'request_id': 'req-46b58459-1e98-4a72-893c-19bcb107fd8c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.899373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 975/1924] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:41 2022] PUT /identity/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c/users/f7cbff27a4744479a48fe12845d358d3/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:41.902737 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.902845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] The token cache is being invalidate because project c6f76455aca1484ba8c2b80b4c7881ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:41.902845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.904630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:41.909858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 950/1925] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:41 2022] DELETE /identity/v3/projects/c6f76455aca1484ba8c2b80b4c7881ef => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:41.913319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:41.913319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:41.933433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58459-1e98-4a72-893c-19bcb107fd8c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:41.996998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80144-0b66-4ab7-af56-980ac288d55e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.007694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.009847 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.010350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.011660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.013632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.017951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.034758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.035522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.035805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.036081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.036811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.038634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.059978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 951/1926] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:42.061221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.063234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:42.065160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 976/1927] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:41 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:42.066019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.095834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3775c9-4482-49ff-ac6a-290431e9b36d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.162220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320aee-7a5c-49c6-82f6-40e7230618fb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.167437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.168412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.169271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.169271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] PATH_INFO: `/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c/users/f7cbff27a4744479a48fe12845d358d3/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.172801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ef7b8d8d54a29870bcaf3d128e07c, user_id=f7cbff27a4744479a48fe12845d358d3, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.177168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.208646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 977/1928] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:42 2022] PUT /identity/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c/users/f7cbff27a4744479a48fe12845d358d3/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:42.213053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.215635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:42.220527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.221438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.221988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.222274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] PATH_INFO: `/v3/users/d956b0763fe94f598bf8d1dc1e96bc74` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.225637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d956b0763fe94f598bf8d1dc1e96bc74)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.227589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.319129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd956b0763fe94f598bf8d1dc1e96bc74'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:42.368628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd956b0763fe94f598bf8d1dc1e96bc74'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:42.376331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241170bd-6c52-45be-b85b-03a02edef62e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.393882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd956b0763fe94f598bf8d1dc1e96bc74'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:42.394959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd956b0763fe94f598bf8d1dc1e96bc74'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:42.396385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd956b0763fe94f598bf8d1dc1e96bc74'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:42.403216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.403987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.405506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.405640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.407006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.409024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.430452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 952/1929] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:42 2022] DELETE /identity/v3/users/d956b0763fe94f598bf8d1dc1e96bc74 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:42.475870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 978/1930] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:42 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:42.478030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.479984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:42.650537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138d00-cf2e-4eae-b7ad-f042c9e18c91 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.670647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.672398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.672710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.672988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.673899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.675836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.700375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 953/1931] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:42.705081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.739884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b51e-87b7-4285-aea6-841e64c79794 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.761664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.763082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.764584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.766420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.767420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.769755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e503c-3a3a-4678-b809-284bc925377d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.810538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 979/1932] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:42.818369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:42.840218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a70d-3764-4e92-8420-7008e1c81772 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:42.850876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:42.851795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.855365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.855673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] PATH_INFO: `/v3/projects/b9090786260b48d3b0b28e41dcbf3753/users/ce0ea698fbd443d086ccdd957c378ec7/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.891916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9090786260b48d3b0b28e41dcbf3753, user_id=ce0ea698fbd443d086ccdd957c378ec7, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:42.901825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:42.927337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 954/1933] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:42 2022] PUT /identity/v3/projects/b9090786260b48d3b0b28e41dcbf3753/users/ce0ea698fbd443d086ccdd957c378ec7/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:42.939038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:42.939241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:42.939683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:42.988749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] MFA Rules not processed for user `ce0ea698fbd443d086ccdd957c378ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:42.990497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:43.132856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 980/1934] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:43.138458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:43.225882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520082e-6e7b-4ac4-8e0b-a3fe7904003c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:43.230992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:43.231711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:43.232002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:43.232420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:43.233288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:43.235783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:43.279174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 955/1935] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:43 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:43.284809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:43.305689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7bd4-6bcb-49ba-b744-0c068c0ed639 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:43.426942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:43.427648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:43.427947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:43.428207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:43.428957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:43.435142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:43.478525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 981/1936] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:43 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:43.493766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:43.516171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f079ce-f55e-4a77-aee9-9712e290f90b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:43.556161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:43.556789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:43.557079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:43.557354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:43.569563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:43.574610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:43.648801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 956/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:43.649290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:43.663602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bf0-9723-4d72-b538-fc356b8e0534 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:43.683328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:43.684781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:43.684781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:43.685218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] PATH_INFO: `/v3/projects/982eef922bed4c968334db59f321b94a/users/9969912b40284924a324821003ba50f5/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:43.732036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982eef922bed4c968334db59f321b94a, user_id=9969912b40284924a324821003ba50f5, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:43.739286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:43.778340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 982/1938] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:43 2022] PUT /identity/v3/projects/982eef922bed4c968334db59f321b94a/users/9969912b40284924a324821003ba50f5/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:43.784029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:43.806791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eac16-c04e-4b53-a3f3-76332e35351b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:43.998373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:43.999899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.000225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.001642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.002425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:44.010618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb86e9a-f7db-4faa-b25b-981f0abebc90 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:44.058918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 957/1939] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:44.060505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:44.075863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea78f-7000-47fd-9c33-ed408345cde6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:44.085888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:44.093036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.096545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.096848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] PATH_INFO: `/v3/projects/982eef922bed4c968334db59f321b94a/users/9969912b40284924a324821003ba50f5/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.102242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982eef922bed4c968334db59f321b94a, user_id=9969912b40284924a324821003ba50f5, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:44.108243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:44.139058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 983/1940] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:44 2022] PUT /identity/v3/projects/982eef922bed4c968334db59f321b94a/users/9969912b40284924a324821003ba50f5/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:44.150264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.151136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.151599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.224371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] MFA Rules not processed for user `9969912b40284924a324821003ba50f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:44.225762 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:44.367204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:44.369103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:44.475113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 958/1941] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:44.481087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:44.486498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:44.540543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06700-377a-4097-8316-a605846a41e7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:44.547488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:44.548513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.548757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.549150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] PATH_INFO: `/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.550806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfed9c8c4fab43e6b7c43f5df09f601b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:44.553817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:44.676113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4bf72-66ee-4b11-9e5d-3701a6a889fa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:44.691805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfed9c8c4fab43e6b7c43f5df09f601b', 'request_id': 'req-d3304863-44c1-4d20-80e9-7f89c4aef506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:44.707146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfed9c8c4fab43e6b7c43f5df09f601b', 'request_id': 'req-d3304863-44c1-4d20-80e9-7f89c4aef506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:44.727376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfed9c8c4fab43e6b7c43f5df09f601b', 'request_id': 'req-d3304863-44c1-4d20-80e9-7f89c4aef506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:44.745106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] The token cache is being invalidate because project cfed9c8c4fab43e6b7c43f5df09f601b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:44.745975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:44.748044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3304863-44c1-4d20-80e9-7f89c4aef506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:44.751047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 984/1942] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:44 2022] DELETE /identity/v3/projects/cfed9c8c4fab43e6b7c43f5df09f601b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:44.756810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.757184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.757564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.816636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:44.817907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:44.824428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:44.825285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:44.825465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:44.825737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:44.830893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:44.935547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:44.939354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cce5e-27e6-4d76-a53b-c9c15008ff2f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:44.956042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 959/1943] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:58:45.012841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 985/1944] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:45.015719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.016502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.017335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.044196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:45.046048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:45.058318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 960/1945] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:45.063421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.073909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ad72-40f2-4c14-8e68-39f486ace060 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.120243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.121160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.121427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.121895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.122786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:45.123261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.125529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.171783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.182925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 986/1946] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:45.183615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6303-673e-48d9-9c4a-49a65c0e8eb3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.196882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.201101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.201434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.202040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.203356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.206088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.274962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.282964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 961/1947] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:45.286859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1ef-92cc-433a-8b9f-1946db8780e4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.436464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.438652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.439132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.439587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.440461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.445030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.476467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 987/1948] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:45 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:45.477736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.491429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dbea6-51bc-4b49-acdb-a106b3960754 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.508552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.509988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.513218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.513771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.514781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.522094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.553994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 962/1949] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:45.554638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.575452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002c398-d1a6-4969-978e-215b86476961 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.585169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.585930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.590273 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.590689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.591580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.593460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9c7ed-8c31-4a1a-aeb5-5af2b6dbd1db admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.613696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 988/1950] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:45.617874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.636560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c420f46-505f-41c1-97e8-e3395a8c68e1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:45.650259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:45.651176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.651459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.651739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] PATH_INFO: `/v3/projects/51a7bfdc6f1d4bfca35f737b85ea54a1/users/9f986e636cd744ba857be8c511537872/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.696184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a7bfdc6f1d4bfca35f737b85ea54a1, user_id=9f986e636cd744ba857be8c511537872, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:45.700021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:45.723314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 963/1951] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:45 2022] PUT /identity/v3/projects/51a7bfdc6f1d4bfca35f737b85ea54a1/users/9f986e636cd744ba857be8c511537872/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:45.734828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:45.735701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:45.736185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:45.788677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] MFA Rules not processed for user `9f986e636cd744ba857be8c511537872`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:45.790618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:45.959615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 989/1952] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:45.971234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.973281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:45.984759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:45.988061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:46.119179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6b1f-2d41-4fb3-b908-813764952d2e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:46.135847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:46.136715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:46.137010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:46.137293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:46.153964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:46.154129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010860-0239-4d8f-a6b2-87e375510029 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:46.154285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6581a-fb2d-402d-86b3-af3b8a13092f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:46.161436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:46.163359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:46.164200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:46.164657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] PATH_INFO: `/v3/users/ce0ea698fbd443d086ccdd957c378ec7` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:46.168017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0ea698fbd443d086ccdd957c378ec7)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:46.170474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:46.181696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 964/1953] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:46.258232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0ea698fbd443d086ccdd957c378ec7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:46.290730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0ea698fbd443d086ccdd957c378ec7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:46.291493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0ea698fbd443d086ccdd957c378ec7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:46.292220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0ea698fbd443d086ccdd957c378ec7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:46.302243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0ea698fbd443d086ccdd957c378ec7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:46.331616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 990/1954] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:45 2022] DELETE /identity/v3/users/ce0ea698fbd443d086ccdd957c378ec7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:46.336548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:46.337257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:46.338351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:46.378299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:46.379632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:46.510325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 965/1955] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:46.524686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:46.528125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:46.653316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a22a4e-8370-4b00-86ac-12e312ea4e8a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:46.658054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:46.658711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:46.658995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:46.659398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:46.670304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:46.674263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:46.684535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 991/1956] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:47.096445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:47.097985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:47.123618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c4573-ac17-4bc0-8f83-4169b9722523 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:47.148877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:47.150499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:47.150854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:47.151246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] PATH_INFO: `/v3/projects/b9090786260b48d3b0b28e41dcbf3753` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:47.152728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9090786260b48d3b0b28e41dcbf3753)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:47.154875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:47.233892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9090786260b48d3b0b28e41dcbf3753', 'request_id': 'req-b5af6853-bd84-4ae1-b087-45cb3ead2013'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.248554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9090786260b48d3b0b28e41dcbf3753', 'request_id': 'req-b5af6853-bd84-4ae1-b087-45cb3ead2013'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.257601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9090786260b48d3b0b28e41dcbf3753', 'request_id': 'req-b5af6853-bd84-4ae1-b087-45cb3ead2013'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.278397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] The token cache is being invalidate because project b9090786260b48d3b0b28e41dcbf3753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:47.278825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.279803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.283244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 966/1957] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:47 2022] DELETE /identity/v3/projects/b9090786260b48d3b0b28e41dcbf3753 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:47.288394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:47.304488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1734a3-636a-4995-a4b2-e24cf34b04ac service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:47.381681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:47.382880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:47.383329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:47.383895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] PATH_INFO: `/v3/users/9969912b40284924a324821003ba50f5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:47.385687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9969912b40284924a324821003ba50f5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:47.388629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:47.466850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9969912b40284924a324821003ba50f5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.494634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9969912b40284924a324821003ba50f5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.495430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9969912b40284924a324821003ba50f5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.496441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9969912b40284924a324821003ba50f5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.511227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4520df9-3461-4528-9a6c-4b1efd088585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9969912b40284924a324821003ba50f5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:47.533108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 992/1958] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:47 2022] DELETE /identity/v3/users/9969912b40284924a324821003ba50f5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:48.515310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:48.517034 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:48.529972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6853-bd84-4ae1-b087-45cb3ead2013 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:48.600455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:48.602108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:48.602393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:48.602670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] PATH_INFO: `/v3/projects/982eef922bed4c968334db59f321b94a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:48.603915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982eef922bed4c968334db59f321b94a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:48.605880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:48.658431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982eef922bed4c968334db59f321b94a', 'request_id': 'req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:48.665206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982eef922bed4c968334db59f321b94a', 'request_id': 'req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:48.674521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982eef922bed4c968334db59f321b94a', 'request_id': 'req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:48.691569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] The token cache is being invalidate because project 982eef922bed4c968334db59f321b94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:48.691964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:48.692876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fc29bee-c8ff-44e8-99d5-1ca3f6bc6161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:48.696647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 967/1959] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:48 2022] DELETE /identity/v3/projects/982eef922bed4c968334db59f321b94a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:48.701309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:48.701883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:48.702014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:48.726647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:48.728102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:48.814437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 993/1960] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:48.822030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:48.822767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:48.822767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:48.848073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:48.850402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:48.869334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 968/1961] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:48.873350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:48.885024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26380-9ce0-4461-85a5-9f0615b744a9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:48.892036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:48.893157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:48.893583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:48.894202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:48.895040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:48.895448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:48.897334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:48.915081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 994/1962] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:58:48.916212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:48.927578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f1a-a463-4406-8e6d-97d361f14912 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:48.932939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:48.933855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:48.934297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:48.934713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:48.935579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:48.937835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:48.996111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 969/1963] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:48 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:49.000041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:49.010545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d02c5-e391-4658-af6c-92d973d8895c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:49.099784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:49.101307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.101626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.101905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.102614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:49.107233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:49.138310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 995/1964] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:48 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:49.142671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:49.154596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46aa5-23e8-43e2-a892-79f76cc25ab1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:49.161100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:49.161986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.162434 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.162966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.164012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:49.168379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:49.200095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 970/1965] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:49.204039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:49.219396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1b9ce-2b61-4f77-857d-6518f422f86a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:49.226306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:49.228056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.229043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.229556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.231105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:49.233867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97484e2-b23e-4bcf-8463-b7c8a70bdd77 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:49.261803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 996/1966] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:49.266264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:49.280050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e08a4-cafa-4678-819d-5d78d9e28710 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:49.288059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:49.289624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.290059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.290479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] PATH_INFO: `/v3/projects/baf427230a4c45ef8f785206a7632930/users/20c9e3f69b2246768219f9658cecad0a/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.311406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf427230a4c45ef8f785206a7632930, user_id=20c9e3f69b2246768219f9658cecad0a, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:49.317100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:49.337798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 971/1967] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:49 2022] PUT /identity/v3/projects/baf427230a4c45ef8f785206a7632930/users/20c9e3f69b2246768219f9658cecad0a/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:49.348871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dee632-44bf-46b9-82f2-4eed38230198 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.349161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dee632-44bf-46b9-82f2-4eed38230198 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.349444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dee632-44bf-46b9-82f2-4eed38230198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.389650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-90dee632-44bf-46b9-82f2-4eed38230198 None None] MFA Rules not processed for user `20c9e3f69b2246768219f9658cecad0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:49.391875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90dee632-44bf-46b9-82f2-4eed38230198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:49.474367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 997/1968] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:49.486623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:49.488370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:49.554266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a2548-a6eb-4f43-8e93-023f3a11dacf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:49.558033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:49.558686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:49.558977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:49.559255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:49.567928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:49.569455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:49.579533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 972/1969] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:50.758644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0218f-bdfc-4fc4-9cc1-1d18c17a1b3b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:50.759215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0218f-bdfc-4fc4-9cc1-1d18c17a1b3b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:50.759215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0218f-bdfc-4fc4-9cc1-1d18c17a1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:50.788193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-dbb0218f-bdfc-4fc4-9cc1-1d18c17a1b3b None None] MFA Rules not processed for user `f7cbff27a4744479a48fe12845d358d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:50.789432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dbb0218f-bdfc-4fc4-9cc1-1d18c17a1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:50.860296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 998/1970] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:50.871906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:50.873305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:50.930322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8a84-94e4-4764-80d2-400f3358b550 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:50.933983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:50.934637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:50.934927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:50.935210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:50.937368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:51.001136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:51.002843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:51.019911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 973/1971] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:51.150852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:51.151146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:51.151428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:51.171782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:51.172862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:51.241815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 999/1972] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:58:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:51.257074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:51.258819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:51.379249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af360-7024-4742-905a-6106aa3da75f service glance] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:51.384862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:51.385851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:51.386232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:51.386625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:51.397527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:51.399589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c032-912b-4208-aaf6-1bd7ccf9ad28 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:51.420343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 974/1973] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 05:58:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 05:58:54.563291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:54.681523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb752c-b4ec-4916-b91f-384478dd347a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:54.687438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:54.688626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:54.689068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:54.689731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] PATH_INFO: `/v3/users/20c9e3f69b2246768219f9658cecad0a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:54.691447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c9e3f69b2246768219f9658cecad0a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:54.693592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:54.785143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c9e3f69b2246768219f9658cecad0a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:54.821159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c9e3f69b2246768219f9658cecad0a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:54.822740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c9e3f69b2246768219f9658cecad0a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:54.823561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c9e3f69b2246768219f9658cecad0a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:54.838702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c9e3f69b2246768219f9658cecad0a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:54.861808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1000/1974] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:54 2022] DELETE /identity/v3/users/20c9e3f69b2246768219f9658cecad0a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:54.866582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:54.867537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:54.868032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:54.913541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:54.916092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:55.138047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 975/1975] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:55.152651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:55.154320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:55.424009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381449-0041-49e8-b1ea-e204808bc472 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:55.428481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:55.429193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:55.429509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:55.429962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:55.458385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:55.461932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:55.475008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1001/1976] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:56.240282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:56.241931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.244859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:56.246920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.272654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75549e3-5591-4875-8890-1a299fe5a4e8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:56.274507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666c7a2-6a57-4691-832e-ec88f331f70c service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:56.283477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:56.284653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:56.285099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:56.294930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] PATH_INFO: `/v3/projects/baf427230a4c45ef8f785206a7632930` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:56.302151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf427230a4c45ef8f785206a7632930)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:56.304436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:56.311412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:56.313242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:56.313777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:56.314480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] PATH_INFO: `/v3/users/9f986e636cd744ba857be8c511537872` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:56.316056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f986e636cd744ba857be8c511537872)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:56.318265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:56.409708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f986e636cd744ba857be8c511537872'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.424561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf427230a4c45ef8f785206a7632930', 'request_id': 'req-4559a6b8-658c-4766-9079-fdb577b6dee5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.450695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f986e636cd744ba857be8c511537872'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.454751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf427230a4c45ef8f785206a7632930', 'request_id': 'req-4559a6b8-658c-4766-9079-fdb577b6dee5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.465924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf427230a4c45ef8f785206a7632930', 'request_id': 'req-4559a6b8-658c-4766-9079-fdb577b6dee5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.472031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f986e636cd744ba857be8c511537872'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.473684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f986e636cd744ba857be8c511537872'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.475122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4cc87792-0a4d-4f9e-84cc-4bf85748f822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f986e636cd744ba857be8c511537872'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.490192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] The token cache is being invalidate because project baf427230a4c45ef8f785206a7632930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:56.490765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.491779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4559a6b8-658c-4766-9079-fdb577b6dee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:56.493781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1002/1977] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:56 2022] DELETE /identity/v3/projects/baf427230a4c45ef8f785206a7632930 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:56.500761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7c3e-4237-4cf4-a956-cd4532836f91 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:56.505396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 976/1978] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:58:56 2022] DELETE /identity/v3/users/9f986e636cd744ba857be8c511537872 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:56.508551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7c3e-4237-4cf4-a956-cd4532836f91 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:56.508551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7c3e-4237-4cf4-a956-cd4532836f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:56.510300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:56.510823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:56.511315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:56.583548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:56.586246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.588727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-436c7c3e-4237-4cf4-a956-cd4532836f91 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:56.589982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-436c7c3e-4237-4cf4-a956-cd4532836f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.753647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 977/1979] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:56.796600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:56.801715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.833567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1003/1980] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:56.841047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:56.841047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:56.841047 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:56.871652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:56.874732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:56.887491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1004/1981] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:56.935365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.001580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ea856-46b3-4f56-9e56-ae635495e88b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.008333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.009359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.009726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.010011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.010757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:57.011069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.012899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.022103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a721276-8872-4fbe-9fc2-7768c8b59767 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.030007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.030986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.031436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.031875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.046509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.049069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.059386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1005/1982] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:57.069046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.087184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d1a-8f6a-419e-bb5c-8da63367882b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.098593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 978/1983] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:58:57.116432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.119570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.120120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.120639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.123087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.129547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.206165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1006/1984] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:57 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:57.209716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.243883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cbd9f-3b66-424d-8efe-a6944a49bd64 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.500991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.501740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.502182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.502473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.503183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.505147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.552944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 979/1985] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:57 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:57.553637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.570110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30c85-9e35-44a3-86ad-3deed957406b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.581828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.582611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.583059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.583445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.585321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.588362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.627364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1007/1986] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:58:57.634473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.673226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749dfbd-0a67-4ce9-8c82-73a96f59f62c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.697443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.699115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.699488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.699822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.702834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.706053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.732644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.735825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:57.751951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 980/1987] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:57.754461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:57.775544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028214-e9eb-414e-8a35-bcc40f5833cc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.786213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.787305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.788106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.791920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] PATH_INFO: `/v3/projects/51a7bfdc6f1d4bfca35f737b85ea54a1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.800475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a7bfdc6f1d4bfca35f737b85ea54a1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.802653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e10e-89a6-41d5-9aed-2fc4cf05d0e2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:57.811360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.813793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:57.817423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.817968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.818485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] PATH_INFO: `/v3/projects/fe53acd4a77d48058873e3bae24bd47b/users/f21fdc5e01e84a8295987994d2b5e672/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.852123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe53acd4a77d48058873e3bae24bd47b, user_id=f21fdc5e01e84a8295987994d2b5e672, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:57.855296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301a7ca-d01b-46df-9426-f806701038d2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:57.886614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a7bfdc6f1d4bfca35f737b85ea54a1', 'request_id': 'req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:57.894390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a7bfdc6f1d4bfca35f737b85ea54a1', 'request_id': 'req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:57.895174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 981/1988] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:57 2022] PUT /identity/v3/projects/fe53acd4a77d48058873e3bae24bd47b/users/f21fdc5e01e84a8295987994d2b5e672/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:57.907582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a7bfdc6f1d4bfca35f737b85ea54a1', 'request_id': 'req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:57.908057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.909073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.909381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.938034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] The token cache is being invalidate because project 51a7bfdc6f1d4bfca35f737b85ea54a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:58:57.938427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:57.939792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-41e3f2e1-4c71-4dac-9b12-d7c16dc6d109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:58:57.945217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1008/1989] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:58:57 2022] DELETE /identity/v3/projects/51a7bfdc6f1d4bfca35f737b85ea54a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:58:57.947569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465611e3-1d7a-477b-b541-dc444afb6769 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:57.947975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465611e3-1d7a-477b-b541-dc444afb6769 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:57.948356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465611e3-1d7a-477b-b541-dc444afb6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:57.969947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] MFA Rules not processed for user `f21fdc5e01e84a8295987994d2b5e672`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:57.971919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:57.976100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-465611e3-1d7a-477b-b541-dc444afb6769 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:57.977376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-465611e3-1d7a-477b-b541-dc444afb6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:58.059570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 982/1990] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:58.068426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1009/1991] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:58.075825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.076115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.076409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.078453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.080971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:58.105361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:58.106983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:58.116424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1010/1992] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:58.123708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.135050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de703-78e9-40a4-9ae0-1098045ec8ad None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.141726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.142718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.143303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.143870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.144747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:58:58.145206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.147067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.161779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1011/1993] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:58:58.167594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.167898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e021b81-8c82-4d4e-92cb-1f49dc1d0657 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.187021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.187710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.188018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.188428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.195260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d31dbf-0afc-42a5-9ecf-4b3018a96660 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.204118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.205655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.206122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.207336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.207627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.207907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.209092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.212661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.224548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 983/1994] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:58:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:58:58.256117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1012/1995] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:58 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:58.260109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.275028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d411-155e-4715-935f-3def504f9b52 service glance] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.362553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.363242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.363670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.363976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.364651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.366725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.411638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 984/1996] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:58 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:58.415466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.430200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812449-1f51-4065-95d3-5f91264e83e7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.444171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.448869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.449369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.450024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.451075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.453937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.496563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1013/1997] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:58.497820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.513187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4af2-649e-4a45-b45b-9c506ec24e76 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.536986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.538316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.538316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.538316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.538969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.540688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6558-4b1f-4410-b48f-10d79542e7d7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.562872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 985/1998] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:58.566804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:58.587669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838957-56aa-456e-9b0d-1db692ffac60 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:58.599914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:58.601128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.603655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.604134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] PATH_INFO: `/v3/projects/b941a0c3931c49a1927d57d4650025db/users/6e204870947f4ba0af69cfb6f228463c/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.651014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b941a0c3931c49a1927d57d4650025db, user_id=6e204870947f4ba0af69cfb6f228463c, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:58.653880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:58.693543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:58.694171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1014/1999] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:58 2022] PUT /identity/v3/projects/b941a0c3931c49a1927d57d4650025db/users/6e204870947f4ba0af69cfb6f228463c/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:58.694421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:58.694885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:58.787005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] MFA Rules not processed for user `6e204870947f4ba0af69cfb6f228463c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:58.788717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:58.942918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 986/2000] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:58:58.947594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.106971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2197d-fddc-4777-8ede-5e18ad527491 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.122178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.122984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.125710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.126199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.127651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.129765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:59.197399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.209073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1015/2001] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:58 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:58:59.213916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109635ad-c2fb-4258-b637-f485cdcb95ff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.346153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.348688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.349337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.350258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.351629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.365532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:59.404479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 987/2002] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:58:59 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:58:59.411205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.427573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bd31-a353-4371-ad98-8cdc699c17e6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.433955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.434717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.435077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.435491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.436387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.438696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:59.454265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1016/2003] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:58:59.458887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.477028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc66c-2bbe-414a-9c29-9c7c0ae1ae97 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.482992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.485335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.485758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.486280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.487174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.488918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bb761-a3e5-46ca-aaad-19b003da0104 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:59.505383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 988/2004] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:58:59.507385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.524634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec232-4ed9-46f0-b5de-c783738f2284 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.541611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.543224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.543671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.544263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] PATH_INFO: `/v3/projects/0e3bd0f798e64e439eb202212dba8569/users/f37b5f2d853a40fb9e24b573605285a2/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.583447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3bd0f798e64e439eb202212dba8569, user_id=f37b5f2d853a40fb9e24b573605285a2, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.586820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:58:59.621191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1017/2005] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:58:59 2022] PUT /identity/v3/projects/0e3bd0f798e64e439eb202212dba8569/users/f37b5f2d853a40fb9e24b573605285a2/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:58:59.631067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.634335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.634786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.688169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] MFA Rules not processed for user `f37b5f2d853a40fb9e24b573605285a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:58:59.689392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:58:59.810541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 989/2006] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:58:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:58:59.815876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:58:59.950254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d56e-1509-42ea-95d9-5a0f2036aa9d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:58:59.959059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:58:59.959798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:58:59.960252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:58:59.960534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:58:59.961828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:58:59.965419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.035512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.036128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1018/2007] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:58:59 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:00.049756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61f76-7696-4b8a-8584-3f6d5bc5c4a7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.083820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.086278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.195668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.196516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.196911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.197307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.198257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.200350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.222938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd237-d4e3-4d22-82d7-d1c568bca4aa admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.235095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.235991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.236282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.236549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] PATH_INFO: `/v3/users/9fdceba628fb45b0a7d42547cd1c0f4f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.237855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdceba628fb45b0a7d42547cd1c0f4f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.239835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.252712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 990/2008] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:00 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:00.258202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.294615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17ea66-4468-4cde-a095-80f3da95f3ce admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.307145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.307842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.308145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.308415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.309157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.310830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.330727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdceba628fb45b0a7d42547cd1c0f4f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.332345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 991/2009] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:00.337107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.353391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708cbd-12f9-45b2-ac3b-9de3101f1e2e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.362367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdceba628fb45b0a7d42547cd1c0f4f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.363132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdceba628fb45b0a7d42547cd1c0f4f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.363767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdceba628fb45b0a7d42547cd1c0f4f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.364229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.365251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.365662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.366014 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] PATH_INFO: `/v3/projects/cbf1e42448b846a598e6550793c4a374/users/c2bd6ea3a08944d3a4f0de65445710ea/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.375496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdceba628fb45b0a7d42547cd1c0f4f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.388269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf1e42448b846a598e6550793c4a374, user_id=c2bd6ea3a08944d3a4f0de65445710ea, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.391708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.404445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1019/2010] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:00 2022] DELETE /identity/v3/users/9fdceba628fb45b0a7d42547cd1c0f4f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:00.413519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 992/2011] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:00 2022] PUT /identity/v3/projects/cbf1e42448b846a598e6550793c4a374/users/c2bd6ea3a08944d3a4f0de65445710ea/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:00.418706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.420958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.512879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18790e57-3ed1-489f-a652-1a81ff8e8d2e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.616126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.616921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.617122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.617377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.618154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.619782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.634907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1020/2012] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:00.638830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.661060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2d5fe-0220-44e2-b076-07d8200e9287 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.670204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.672075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.672508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.672967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] PATH_INFO: `/v3/projects/cbf1e42448b846a598e6550793c4a374/users/c2bd6ea3a08944d3a4f0de65445710ea/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.673181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.676788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.677635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf1e42448b846a598e6550793c4a374, user_id=c2bd6ea3a08944d3a4f0de65445710ea, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.681072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7273a77-2b31-4f3f-a30f-3fb809dbc642 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.693564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd34ae3-e4c3-4d6f-9d03-d5148d51240c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:00.695190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 993/2013] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:00 2022] PUT /identity/v3/projects/cbf1e42448b846a598e6550793c4a374/users/c2bd6ea3a08944d3a4f0de65445710ea/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:00.706345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.706639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.707025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.744344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] MFA Rules not processed for user `c2bd6ea3a08944d3a4f0de65445710ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:00.750590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.783024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:00.784046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.784414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.784773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] PATH_INFO: `/v3/projects/98d1a529cc4d4a11b49d9e08ae5b2f69` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.786250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d1a529cc4d4a11b49d9e08ae5b2f69)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:00.788429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:00.855436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 994/2014] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:00.861835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'request_id': 'req-863874cd-9873-4f69-aca5-13728e7c0688'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.869916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'request_id': 'req-863874cd-9873-4f69-aca5-13728e7c0688'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.870142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:00.871750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.884345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'request_id': 'req-863874cd-9873-4f69-aca5-13728e7c0688'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.900756 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] The token cache is being invalidate because project 98d1a529cc4d4a11b49d9e08ae5b2f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:00.901734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.911247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-863874cd-9873-4f69-aca5-13728e7c0688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:00.913648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1021/2015] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:00 2022] DELETE /identity/v3/projects/98d1a529cc4d4a11b49d9e08ae5b2f69 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:00.920319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd977-6b49-4302-adc5-c9a881183a96 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:00.921432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd977-6b49-4302-adc5-c9a881183a96 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:00.922094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd977-6b49-4302-adc5-c9a881183a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:00.945976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d98fd977-6b49-4302-adc5-c9a881183a96 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:00.947395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d98fd977-6b49-4302-adc5-c9a881183a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:00.953517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685014e0-6f86-46e7-9830-293a4ac00f34 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.031643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.032759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.033243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.033854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.036220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:01.046690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1022/2016] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:01.055478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.055777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.056065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.083873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:01.085089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:01.096826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1023/2017] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:01.097978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.108011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1f95-9658-4695-8c0e-89d406704936 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.114053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.114747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.115077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.115364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.116133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:01.116445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.118098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.133361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.135481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1024/2018] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:59:01.136418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.138532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.148550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3026-122d-4292-886a-fc2428fc2727 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.153705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 995/2019] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:59:01.154069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.154730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.155700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.155985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.156682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.158621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.193647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1025/2020] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:01.197249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.211342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67d-5e0f-4022-bc51-4a0a937aa88c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.309089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.310560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.310560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.310560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.315383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.317689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.352785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.353385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 996/2021] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:01.369313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d75e6-76cc-460d-a99d-ae2910ded6e3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.381255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.383404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.383676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.383966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.395925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.399293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.420120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1026/2022] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:01.426295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.455107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dba9-e7b8-485d-8b54-f62d409ba7eb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.550372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.550372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.550372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.550372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.550785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.550785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a963f-ef95-4d6e-ad82-7cfc97740b54 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.550785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 997/2023] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:01.562874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.590336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452d4f-a9f4-445b-ba36-5e1668ff54d1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.611041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.612653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.613280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.613865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] PATH_INFO: `/v3/projects/ca26b5d993a049278f82860d72c78f27/users/b9ebc6b328ca4d54ad611930e071bf0d/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.650667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca26b5d993a049278f82860d72c78f27, user_id=b9ebc6b328ca4d54ad611930e071bf0d, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.662410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.692679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1027/2024] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:01 2022] PUT /identity/v3/projects/ca26b5d993a049278f82860d72c78f27/users/b9ebc6b328ca4d54ad611930e071bf0d/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:01.703779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.704190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.704579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.745376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] MFA Rules not processed for user `b9ebc6b328ca4d54ad611930e071bf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:01.749529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:01.853379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 998/2025] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:01.858131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.926473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc97b5e-e23c-4064-b394-d25f10a5a78b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:01.933296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:01.935293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:01.935780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:01.936065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:01.938338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:01.940429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:01.975473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1028/2026] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:01.976625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:01.990243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f671d7-d997-4dbf-bc35-c873457b6e7c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.054957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.055651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.055945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.056227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.058108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.059607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.088384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 999/2027] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:01 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:02.089584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.102119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fd240-4acd-48f8-a26f-87e699f00fe9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.107516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.109121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.109707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.110053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.112704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.113701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.125733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1029/2028] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:59:02.129909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.140399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a98-a909-409a-b5f4-a49b29cbdf81 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.148902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.149855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.150156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.150425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] PATH_INFO: `/v3/projects/c7b9adcf14ae4900992ed98a2662e111/users/b2060e7c577a43988d965640300a250b/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.168429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b9adcf14ae4900992ed98a2662e111, user_id=b2060e7c577a43988d965640300a250b, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.171215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.207097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.207451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1000/2029] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:02 2022] PUT /identity/v3/projects/c7b9adcf14ae4900992ed98a2662e111/users/b2060e7c577a43988d965640300a250b/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:02.218261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cd635-d738-4f21-835e-046be1b6c904 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.294637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.295310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.296110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.296386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.297310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.298939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b296e0-b4b2-4cd6-9d33-356d307e49d6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.316278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1030/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:02.318711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.330941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14f9f5-94b8-4329-a9af-86ad9bbc50eb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.339596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.340541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.341021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.341383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] PATH_INFO: `/v3/projects/c7b9adcf14ae4900992ed98a2662e111/users/b2060e7c577a43988d965640300a250b/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.344460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b9adcf14ae4900992ed98a2662e111, user_id=b2060e7c577a43988d965640300a250b, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.347243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.364224 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1001/2031] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:02 2022] PUT /identity/v3/projects/c7b9adcf14ae4900992ed98a2662e111/users/b2060e7c577a43988d965640300a250b/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:02.376423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.376942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.377232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.431761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] MFA Rules not processed for user `b2060e7c577a43988d965640300a250b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:02.433112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:02.533080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1031/2032] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:02.546013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.548096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:02.617556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9929-2341-411c-a371-f2b33e2bff85 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.621628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.622299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.622586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.623433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.634780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.636214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.648486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1002/2033] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:02.736478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:02.750740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f5e3d-1db5-40c1-9b57-8481bc1441c4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:02.761850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:02.762513 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:02.763306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:02.763306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:02.839326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:02.841155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:02.853517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1032/2034] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:03.009370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:03.011200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:03.024641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753fbfc-0906-49af-9af8-327795d8160a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:03.035426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:03.036504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:03.036944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:03.037365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:03.039374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:03.137512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:03.139168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:03.149332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1003/2035] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:03.853103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:03.867324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7506-ba76-45fa-a3fc-73361423030e service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:03.871621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:03.872362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:03.872860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:03.873234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:03.876880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:03.967118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:03.969978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4796ff-ce27-45b3-acbb-ed677c417c99 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:03.981418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1033/2036] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:05.797194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:05.873635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924741-f7a0-4bd2-a6fe-6453a1eb3c29 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:05.879201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:05.880378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:05.880665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:05.880946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] PATH_INFO: `/v3/users/b9ebc6b328ca4d54ad611930e071bf0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:05.883308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ebc6b328ca4d54ad611930e071bf0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:05.885252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:05.935775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ebc6b328ca4d54ad611930e071bf0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:05.949791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ebc6b328ca4d54ad611930e071bf0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:05.956862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ebc6b328ca4d54ad611930e071bf0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:05.957776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ebc6b328ca4d54ad611930e071bf0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:05.958391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ebc6b328ca4d54ad611930e071bf0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:05.982065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1004/2037] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:05 2022] DELETE /identity/v3/users/b9ebc6b328ca4d54ad611930e071bf0d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:05.987797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339da11-d5fa-4e90-8688-5375c70196df None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:05.988470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339da11-d5fa-4e90-8688-5375c70196df None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:05.988564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339da11-d5fa-4e90-8688-5375c70196df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:06.007889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f339da11-d5fa-4e90-8688-5375c70196df None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:06.009389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f339da11-d5fa-4e90-8688-5375c70196df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:06.081560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1034/2038] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:06.087883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:06.089637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:06.149129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0259e-b05c-4630-afaf-4b3c69573b60 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:06.152806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:06.153642 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:06.153973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:06.154255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:06.163740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:06.165309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:06.181065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1005/2039] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:06.215340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:06.215930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:06.216509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:06.238774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] MFA Rules not processed for user `9f19dad38bba4adb9267a1fcbc26d7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:06.239980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:06.307136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1035/2040] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:06.572062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:06.573850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:06.590217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866a13-5080-4ebc-8409-74124d9daa36 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:06.606107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:06.606107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:06.606107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:06.606107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] PATH_INFO: `/v3/projects/ca26b5d993a049278f82860d72c78f27` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:06.606523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca26b5d993a049278f82860d72c78f27)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:06.610119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:06.684071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca26b5d993a049278f82860d72c78f27', 'request_id': 'req-f0cd6560-73d5-45fc-8787-f15055142260'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.691333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca26b5d993a049278f82860d72c78f27', 'request_id': 'req-f0cd6560-73d5-45fc-8787-f15055142260'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.701179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca26b5d993a049278f82860d72c78f27', 'request_id': 'req-f0cd6560-73d5-45fc-8787-f15055142260'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.722555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] The token cache is being invalidate because project ca26b5d993a049278f82860d72c78f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:06.722878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.729415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.731277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1006/2041] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:06 2022] DELETE /identity/v3/projects/ca26b5d993a049278f82860d72c78f27 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:06.735609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:06.749137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142c3b-a58b-4886-abd0-fc84c9d29a9f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:06.820352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:06.821230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:06.821536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:06.821815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] PATH_INFO: `/v3/users/b2060e7c577a43988d965640300a250b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:06.823005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2060e7c577a43988d965640300a250b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:06.824972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:06.884794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2060e7c577a43988d965640300a250b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.901203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2060e7c577a43988d965640300a250b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.901946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2060e7c577a43988d965640300a250b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.902980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2060e7c577a43988d965640300a250b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.915986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-378daeea-829f-4642-a717-8ce1d67a753d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2060e7c577a43988d965640300a250b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:06.930505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1036/2042] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:06 2022] DELETE /identity/v3/users/b2060e7c577a43988d965640300a250b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:07.274927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.277170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:07.297185 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6560-73d5-45fc-8787-f15055142260 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.369515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.369515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.369736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.370272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] PATH_INFO: `/v3/projects/c7b9adcf14ae4900992ed98a2662e111` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.371621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b9adcf14ae4900992ed98a2662e111)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.373857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.426585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b9adcf14ae4900992ed98a2662e111', 'request_id': 'req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:07.432967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b9adcf14ae4900992ed98a2662e111', 'request_id': 'req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:07.441299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b9adcf14ae4900992ed98a2662e111', 'request_id': 'req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:07.456570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] The token cache is being invalidate because project c7b9adcf14ae4900992ed98a2662e111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:07.456865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:07.457558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b79c454-5c29-4ed5-beb5-e3db6b7d6ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:07.459130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1007/2043] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:07 2022] DELETE /identity/v3/projects/c7b9adcf14ae4900992ed98a2662e111 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:07.464871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.465382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.466075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.487239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:07.488567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:07.577356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1037/2044] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:07.585959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.586243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.586519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.606051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:07.607256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:07.615530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1008/2045] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:07.620994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.632587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449e90-3bef-4020-bb45-470b308f34eb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.637285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.637974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.638260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.638538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.639842 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:07.640352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.642229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.654253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1038/2046] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:59:07.659890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.669155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d93c4-e117-4f98-8468-0c095df72d36 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.674447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.675087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.675376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.675662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.676412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.678496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.710975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1009/2047] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:07 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:07.715584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.726877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a763e-ca86-42ab-a92d-e2c4e6775f87 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.785302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.786003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.786288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.786564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.787260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.789187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.811660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1039/2048] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:07 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:07.816004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.827241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c2ea-4016-4635-a363-895f7df88cef admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.831825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.832564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.832871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.833222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.834233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.836029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.848071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1010/2049] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:07.852149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.862678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a53cce-fee1-4740-b547-a0ad272facc5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.867380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.868036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.868326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.868688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.869581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.871240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611c151-57fe-4322-80f2-410ded861202 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.882411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1040/2050] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:07.886588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:07.896957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4ccd-aa5e-45c7-98ee-c9d0c9e7c467 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:07.901668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:07.902545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.902832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.903110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] PATH_INFO: `/v3/projects/e4a7c0914c1e4ae49ea0aa53ce695dac/users/2750936295cb4a63a77526e7ae79de15/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.917585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a7c0914c1e4ae49ea0aa53ce695dac, user_id=2750936295cb4a63a77526e7ae79de15, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:07.920375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:07.934538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1011/2051] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:07 2022] PUT /identity/v3/projects/e4a7c0914c1e4ae49ea0aa53ce695dac/users/2750936295cb4a63a77526e7ae79de15/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:07.945844 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:07.946139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:07.946448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:07.978192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] MFA Rules not processed for user `2750936295cb4a63a77526e7ae79de15`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:07.979396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.031813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.033503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.048548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1041/2052] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:08.053259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.107831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d98ad-deb7-44df-a2ac-c3416134ebf4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.116481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.117833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.119108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.119735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] PATH_INFO: `/v3/users/6e204870947f4ba0af69cfb6f228463c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.122085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e204870947f4ba0af69cfb6f228463c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.125033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f8b4f-7fc3-47ad-9a5a-14dcb13e2929 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.125221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.131454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.132384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.132915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.133320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.134437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.138819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.189596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e204870947f4ba0af69cfb6f228463c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:08.189920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1042/2053] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:08 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:08.190933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.203809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e204870947f4ba0af69cfb6f228463c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:08.212928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e204870947f4ba0af69cfb6f228463c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:08.213992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e204870947f4ba0af69cfb6f228463c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:08.214683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-58232a12-fadb-44bc-80d4-64d93b695529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e204870947f4ba0af69cfb6f228463c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:08.230321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1012/2054] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:08 2022] DELETE /identity/v3/users/6e204870947f4ba0af69cfb6f228463c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:08.235400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.235812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.236161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.259890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:08.261258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.268052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fad64-e8c4-4e21-96c5-3d6cd848f73f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.335317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.336044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.337301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.337786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.339022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.339825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1013/2055] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:08.341014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.349923 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.351994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.368251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1043/2056] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:08 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:08.372051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.374995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.393166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f4d23-83a9-4f92-a4c9-4477a3f38844 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.400765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.401262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.401509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.401799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.402641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.404619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.416827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1044/2057] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:08.421638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.433690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77a1-3427-4d46-96ee-68d07e3508c5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.434665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783503-df3a-4a5c-b2ee-e82871d21988 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.439353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.439506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.439950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.440237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.440518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.440624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.440937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.441895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] PATH_INFO: `/v3/projects/a2129985c97b4b3a84a369bd741bf33e/users/26866ad31a5248248c33914048a48c51/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.450768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.453055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.459351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2129985c97b4b3a84a369bd741bf33e, user_id=26866ad31a5248248c33914048a48c51, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.462418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.466849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1014/2058] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:59:08.477731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1045/2059] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:08 2022] PUT /identity/v3/projects/a2129985c97b4b3a84a369bd741bf33e/users/26866ad31a5248248c33914048a48c51/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:08.481754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.494146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131aff9-da66-45f3-a8c4-5285d936389e service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.560659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.561455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.561773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.562050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.562789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.564404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975b9e-fc79-47d8-9e99-62615b91ce3e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.577209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1015/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:08.580169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.590388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805028-18ee-4348-87ae-b5aa609bb27c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.598566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.599959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.600311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.600653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] PATH_INFO: `/v3/projects/a2129985c97b4b3a84a369bd741bf33e/users/26866ad31a5248248c33914048a48c51/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.602824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2129985c97b4b3a84a369bd741bf33e, user_id=26866ad31a5248248c33914048a48c51, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.605807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598b3f-e344-48ab-ae21-4ce33b7b7a8f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.628591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.628926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.629243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.630581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1046/2061] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:08 2022] PUT /identity/v3/projects/a2129985c97b4b3a84a369bd741bf33e/users/26866ad31a5248248c33914048a48c51/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:08.664074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] MFA Rules not processed for user `26866ad31a5248248c33914048a48c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:08.665314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.685141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.685575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.686527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.710932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:08.712170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.761525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1016/2062] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:08.775639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.777571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.779308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1047/2063] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 05:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:08.795338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.804605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:08.869814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982cf8-84ae-433f-be4b-1a7c0a6bec7a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.874097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.874766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.875076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.875486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.886791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.889191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.896148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0acaec-fccb-499e-9353-c67a65461bdd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:08.901380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:08.902168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:08.902357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:08.902616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:08.904785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1017/2064] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:59:08.911616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:08.913358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:08.929901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1048/2065] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 05:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 05:59:08.994766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:08.996998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:09.018078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:09.033618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d75e-86f5-4dea-ba0b-adb2a07566a6 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:09.038541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:09.046275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:09.046562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:09.046965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:09.050378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:09.126333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab290-8776-4e2c-82a9-8ec7e42c025c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:09.138652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:09.140429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:09.141088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:09.141378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] PATH_INFO: `/v3/projects/b941a0c3931c49a1927d57d4650025db` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:09.150394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b941a0c3931c49a1927d57d4650025db)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:09.152367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:09.216125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:09.226127 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:09.251569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1049/2066] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:59:09.273557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b941a0c3931c49a1927d57d4650025db', 'request_id': 'req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.296146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b941a0c3931c49a1927d57d4650025db', 'request_id': 'req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.309789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b941a0c3931c49a1927d57d4650025db', 'request_id': 'req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.346265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] The token cache is being invalidate because project b941a0c3931c49a1927d57d4650025db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:09.348497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.362989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.364637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1018/2067] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:08 2022] DELETE /identity/v3/projects/b941a0c3931c49a1927d57d4650025db => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:09.369512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:09.398518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d2e5-a4af-4c5c-8206-67a9705dc734 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:09.556232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:09.556232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:09.556232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:09.556232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] PATH_INFO: `/v3/users/f37b5f2d853a40fb9e24b573605285a2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:09.557532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37b5f2d853a40fb9e24b573605285a2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:09.557532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:09.648160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37b5f2d853a40fb9e24b573605285a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.667634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37b5f2d853a40fb9e24b573605285a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.668937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37b5f2d853a40fb9e24b573605285a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.669665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37b5f2d853a40fb9e24b573605285a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.682109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37b5f2d853a40fb9e24b573605285a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:09.703341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1050/2068] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:09 2022] DELETE /identity/v3/users/f37b5f2d853a40fb9e24b573605285a2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:10.271236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:10.272849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:10.294195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83571ff0-3fe7-4cd3-9b0d-94fe1d0e9d0d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:10.411037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:10.411988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:10.412370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:10.412663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] PATH_INFO: `/v3/projects/0e3bd0f798e64e439eb202212dba8569` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:10.414777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3bd0f798e64e439eb202212dba8569)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:10.416913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:10.532755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3bd0f798e64e439eb202212dba8569', 'request_id': 'req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.541539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3bd0f798e64e439eb202212dba8569', 'request_id': 'req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.551952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3bd0f798e64e439eb202212dba8569', 'request_id': 'req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.573496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] The token cache is being invalidate because project 0e3bd0f798e64e439eb202212dba8569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:10.574763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.576037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.579726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1019/2069] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:10 2022] DELETE /identity/v3/projects/0e3bd0f798e64e439eb202212dba8569 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:10.584040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:10.585719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:10.611774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd356225-5b4b-4c34-a44c-45e4db6f76e1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:10.763439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:10.764912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:10.765232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:10.765547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] PATH_INFO: `/v3/users/c2bd6ea3a08944d3a4f0de65445710ea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:10.767240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bd6ea3a08944d3a4f0de65445710ea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:10.769276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:10.885692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bd6ea3a08944d3a4f0de65445710ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.900093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bd6ea3a08944d3a4f0de65445710ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.901196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bd6ea3a08944d3a4f0de65445710ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.902072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bd6ea3a08944d3a4f0de65445710ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.916283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5d554960-245a-4812-a081-c753286a6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bd6ea3a08944d3a4f0de65445710ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:10.940640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1051/2070] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:10 2022] DELETE /identity/v3/users/c2bd6ea3a08944d3a4f0de65445710ea => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:11.409344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:11.412006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:11.481196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbcf6b-d168-4f0a-80f8-bfb7a9ae4278 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:11.612204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:11.613499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:11.614039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:11.614680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] PATH_INFO: `/v3/projects/cbf1e42448b846a598e6550793c4a374` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:11.616392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf1e42448b846a598e6550793c4a374)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:11.621430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:11.719288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf1e42448b846a598e6550793c4a374', 'request_id': 'req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:11.730560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf1e42448b846a598e6550793c4a374', 'request_id': 'req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:11.739523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf1e42448b846a598e6550793c4a374', 'request_id': 'req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:11.774403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] The token cache is being invalidate because project cbf1e42448b846a598e6550793c4a374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:11.774943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:11.776082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-95d0e8eb-0b93-4867-b2fe-72a26a0c25c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:11.782950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1020/2071] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:11 2022] DELETE /identity/v3/projects/cbf1e42448b846a598e6550793c4a374 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:11.784199 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:11.784662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:11.784771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:11.828928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:11.830318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:11.909264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1052/2072] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:11.924528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:11.924897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:11.925092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:11.945236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:11.946473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:11.962363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1021/2073] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:11.963477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:11.973977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63aa17-48fb-4726-8f45-eef2d76b2f90 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:11.979549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:11.980558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:11.980883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:11.981170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:11.982110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:11.982446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:11.999378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.025239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1053/2074] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:59:12.030974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.043231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c85d3-c178-400f-8086-e47894b44f4d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.048558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.049225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.049614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.049898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.050597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.052626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.088262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1022/2075] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:12.088915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.100122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87274-a78e-420b-8970-c09afcc94dea admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.209348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.210119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.210413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.210693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.211455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.213396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.244029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1054/2076] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:12 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:12.247954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.259948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5ce90-ca75-43fb-82a0-3ccb87443fe3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.265506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.266488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.266833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.267176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.267974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.269713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.281387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1023/2077] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:12.285446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.298064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611007-cdea-404d-b8f4-d1357463d0d5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.304079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.305016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.305381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.305963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.306870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.308486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812288-8b48-4610-8ed9-f32a9943b0ff admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.321783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1055/2078] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:12.325863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.337849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca44e0-e968-4ca4-b15c-bf918bf805d7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.342792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.343799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.344083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.344407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] PATH_INFO: `/v3/projects/12ba636dcfc34045b8b7fd82fa770bc0/users/bbc14e1f89334e65b24fec7b4a321c5d/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.360718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ba636dcfc34045b8b7fd82fa770bc0, user_id=bbc14e1f89334e65b24fec7b4a321c5d, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.363889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.378711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1024/2079] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:12 2022] PUT /identity/v3/projects/12ba636dcfc34045b8b7fd82fa770bc0/users/bbc14e1f89334e65b24fec7b4a321c5d/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:12.384655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.384946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.385227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.411175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:12.412518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:12.474698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1056/2080] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:12.484981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:12.486966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:12.549197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedbb7-8f89-4041-b8fb-671849d9f2ba admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:12.552918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:12.553608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:12.553895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:12.554175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:12.563005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:12.564447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89bd1-1332-4d41-9cc5-d9839933aa9e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:12.574511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1025/2081] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 05:59:15.279235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:15.282155 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:15.308642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508042e0-2740-4ffc-8388-7b3358d5920d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:15.317663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:15.318817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:15.319120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:15.319410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] PATH_INFO: `/v3/users/2750936295cb4a63a77526e7ae79de15` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:15.347915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2750936295cb4a63a77526e7ae79de15)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:15.349980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:15.447494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2750936295cb4a63a77526e7ae79de15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:15.479296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2750936295cb4a63a77526e7ae79de15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:15.480062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2750936295cb4a63a77526e7ae79de15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:15.480683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2750936295cb4a63a77526e7ae79de15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:15.495864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2750936295cb4a63a77526e7ae79de15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:15.527304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1057/2082] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:15 2022] DELETE /identity/v3/users/2750936295cb4a63a77526e7ae79de15 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:15.529343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135454-7783-4e59-841f-56ed3231391a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:15.530457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135454-7783-4e59-841f-56ed3231391a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:15.530457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135454-7783-4e59-841f-56ed3231391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:15.573632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-06135454-7783-4e59-841f-56ed3231391a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:15.579226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06135454-7783-4e59-841f-56ed3231391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:15.694819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1026/2083] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:15.707833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:15.710267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:15.864795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a132d-76cb-4c3c-8175-2f8ba263ec6a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:15.881159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:15.881870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:15.882158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:15.882432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:15.898176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:15.899649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:15.925675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1058/2084] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:16.880663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135454-7783-4e59-841f-56ed3231391a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:16.884360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06135454-7783-4e59-841f-56ed3231391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:16.932882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135454-7783-4e59-841f-56ed3231391a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:16.942454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:16.944295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:16.944749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:16.945333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] PATH_INFO: `/v3/projects/e4a7c0914c1e4ae49ea0aa53ce695dac` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:16.946826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a7c0914c1e4ae49ea0aa53ce695dac)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:16.957765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:17.050346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a7c0914c1e4ae49ea0aa53ce695dac', 'request_id': 'req-25244498-6365-45c3-b908-8b80a3d51299'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.065739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a7c0914c1e4ae49ea0aa53ce695dac', 'request_id': 'req-25244498-6365-45c3-b908-8b80a3d51299'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.081147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a7c0914c1e4ae49ea0aa53ce695dac', 'request_id': 'req-25244498-6365-45c3-b908-8b80a3d51299'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.112882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] The token cache is being invalidate because project e4a7c0914c1e4ae49ea0aa53ce695dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:17.113182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.115615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.127521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1027/2085] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:16 2022] DELETE /identity/v3/projects/e4a7c0914c1e4ae49ea0aa53ce695dac => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:17.131160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:17.149018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292e05b-3aa0-420e-83d0-25d91158426a service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:17.328073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:17.329389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:17.335130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:17.339780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] PATH_INFO: `/v3/users/26866ad31a5248248c33914048a48c51` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:17.344347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26866ad31a5248248c33914048a48c51)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:17.346855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:17.463432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26866ad31a5248248c33914048a48c51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.510837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26866ad31a5248248c33914048a48c51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.515603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26866ad31a5248248c33914048a48c51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.517939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26866ad31a5248248c33914048a48c51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.548567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f695e2ca-01cb-4705-a903-d2a7b479b8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26866ad31a5248248c33914048a48c51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:17.579366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1059/2086] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:17 2022] DELETE /identity/v3/users/26866ad31a5248248c33914048a48c51 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:18.047437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:18.049971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:18.078114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244498-6365-45c3-b908-8b80a3d51299 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:18.185519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:18.186729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:18.187182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:18.187625 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] PATH_INFO: `/v3/projects/a2129985c97b4b3a84a369bd741bf33e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:18.198921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2129985c97b4b3a84a369bd741bf33e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:18.203203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:18.276441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2129985c97b4b3a84a369bd741bf33e', 'request_id': 'req-47146edf-544c-4810-ad42-bac12121b789'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:18.296916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2129985c97b4b3a84a369bd741bf33e', 'request_id': 'req-47146edf-544c-4810-ad42-bac12121b789'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:18.306220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2129985c97b4b3a84a369bd741bf33e', 'request_id': 'req-47146edf-544c-4810-ad42-bac12121b789'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:18.328269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] The token cache is being invalidate because project a2129985c97b4b3a84a369bd741bf33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:18.328910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:18.330128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47146edf-544c-4810-ad42-bac12121b789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:18.333964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1028/2087] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:18 2022] DELETE /identity/v3/projects/a2129985c97b4b3a84a369bd741bf33e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:18.338502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:18.339382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:18.339830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:18.376530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:18.381941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:18.558587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1060/2088] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:18.567203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:18.567511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:18.567798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:18.637031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:18.647511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:18.686788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1029/2089] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:18.688648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:18.699363 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1eaf9e-e64e-40df-becb-53d4c69b182c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:18.720522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:18.721191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:18.721493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:18.721788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:18.722531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:18.722843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:18.724478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:18.757706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1061/2090] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:59:18.758927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:18.774022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38731a-6ab5-4dcb-9f8a-f9967f36b5e0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:18.797218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:18.798112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:18.798408 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:18.798702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:18.799422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:18.805234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:18.869321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1030/2091] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:18 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:18.873356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:18.884375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128d5c-1de1-4bf5-829b-342df45d3328 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.011301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.012003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.012419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.012658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.018070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.021299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.058018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1062/2092] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:18 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:19.062686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.084268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1c94-c50d-4216-a28b-110fde66ef81 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.091700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.093827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.094424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.094947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.096343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.098512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.180648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.205794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1031/2093] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:19.217591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18873c-2c9d-4fbf-b9c3-6677f74d4b74 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.235464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.237058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.237902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.238740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.240080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.242198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169ade0-7e18-4b85-a957-8e8d82a1bde8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.285240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1063/2094] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:19.303159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.339965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b9d90-c2cd-464f-a53a-36c6714a1fe0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.350044 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.351523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.352095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.352589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] PATH_INFO: `/v3/projects/d870647d574d42368a76fadd59025898/users/ca21fc99f82149b2a23a846e80caa95e/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.398037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d870647d574d42368a76fadd59025898, user_id=ca21fc99f82149b2a23a846e80caa95e, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.406810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.440048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1032/2095] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:19 2022] PUT /identity/v3/projects/d870647d574d42368a76fadd59025898/users/ca21fc99f82149b2a23a846e80caa95e/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:19.451718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.452835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.453336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.499378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] MFA Rules not processed for user `ca21fc99f82149b2a23a846e80caa95e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:19.500759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:19.616295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1064/2096] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:19.620409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.706794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba0503-004b-4ed9-8e13-76c53ce09ceb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.711620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.712295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.712582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.712863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.713597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.715599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.743062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1033/2097] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:19 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:19.746901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.758078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae956de-0d02-48ef-82d3-8fe07c8a7b05 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.832174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.832968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.833319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.833713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.834491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.836630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.865170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1065/2098] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:19 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:19.868859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.879931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fcebd-a84d-4bfc-9fa2-1d811c5ee651 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.885081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.885793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.886080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.886505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.887242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.890367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.902816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1034/2099] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:19.907444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:19.917885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20d436-a67d-4a79-b173-0ef29ef46f76 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:19.925819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:19.926720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:19.927009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:19.927292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] PATH_INFO: `/v3/projects/e6d44ebf930248eea954d14f677f112d/users/62281b3c09704007aab628da8df13fb2/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:19.967311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d44ebf930248eea954d14f677f112d, user_id=62281b3c09704007aab628da8df13fb2, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:19.971694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:19.998816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1066/2100] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:19 2022] PUT /identity/v3/projects/e6d44ebf930248eea954d14f677f112d/users/62281b3c09704007aab628da8df13fb2/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:20.002713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.017819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7603-4cfd-4375-ab84-84492e3625ec admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.109834 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.114583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.114879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.115164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.116086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.118836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489287e3-ec1b-4ad3-8a2d-a770d29a33c8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.136668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1035/2101] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:20.137946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.154131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8878227-62bb-4c28-ba09-6457afb01fb0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.170249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.171427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.171427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.171709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] PATH_INFO: `/v3/projects/e6d44ebf930248eea954d14f677f112d/users/62281b3c09704007aab628da8df13fb2/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.174828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d44ebf930248eea954d14f677f112d, user_id=62281b3c09704007aab628da8df13fb2, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.177798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cf993-ab71-4a8b-969d-63bc28d4a3c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.204671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1067/2102] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:20 2022] PUT /identity/v3/projects/e6d44ebf930248eea954d14f677f112d/users/62281b3c09704007aab628da8df13fb2/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:20.214506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.214795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.215259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.251269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] MFA Rules not processed for user `62281b3c09704007aab628da8df13fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:20.252747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:20.277741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.278222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.278654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.307914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] MFA Rules not processed for user `bbc14e1f89334e65b24fec7b4a321c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:20.309444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:20.340443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1036/2103] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:20.352722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.354200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:20.377627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1068/2104] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:20.381994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.383499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:20.435120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14238a76-63dc-4b3a-9b68-1d32f0599fe2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.439352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.440120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.440509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.440896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.451956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.453502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.464148 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1037/2105] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:20.466472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957cb88-003f-4691-9bda-d6fd3d370434 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.472552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.473214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.473522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.473804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.474488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.476596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.509434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1069/2106] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:20 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:20.516823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.525267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67370-4d33-46da-9f7a-7b8498e9e44c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.585821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.586532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.586820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.587102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.587792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.589808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.616561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1038/2107] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:20 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:20.621674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.629709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07259fe-aa63-465e-81e0-5c8a374e72a6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.634817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.635497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.635780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.636083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.636803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.638637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.655311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1070/2108] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:20.657745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.669306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0c46-7c48-4de5-a05c-58fb8abe7f4c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.674190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.675359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.675880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.676252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] PATH_INFO: `/v3/projects/d35aae6b03cb456c96348d9c6b008ab1/users/97d51f046add49a9a991b55cbede2e89/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.694159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35aae6b03cb456c96348d9c6b008ab1, user_id=97d51f046add49a9a991b55cbede2e89, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.696874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.711940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1039/2109] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:20 2022] PUT /identity/v3/projects/d35aae6b03cb456c96348d9c6b008ab1/users/97d51f046add49a9a991b55cbede2e89/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:20.715923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.726460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750252-b5b7-4058-a52d-1b9f7f7a1987 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.790567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.791239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.791553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.791858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.792585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.794256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.806032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1071/2110] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:20.809987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.821957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fadb-f061-4b96-be24-047eaacae6b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.831475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.832360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.832644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.832922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] PATH_INFO: `/v3/projects/d35aae6b03cb456c96348d9c6b008ab1/users/97d51f046add49a9a991b55cbede2e89/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.835008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35aae6b03cb456c96348d9c6b008ab1, user_id=97d51f046add49a9a991b55cbede2e89, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.837695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc71df-1256-4daa-a3e3-ed1d08d1b6e4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.845438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:20.851398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1040/2111] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:20 2022] PUT /identity/v3/projects/d35aae6b03cb456c96348d9c6b008ab1/users/97d51f046add49a9a991b55cbede2e89/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:20.855684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78bfc0-0e6f-42de-bad1-5b6f3a1e917f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:20.918394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:20.919297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:20.919579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:20.919915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] PATH_INFO: `/v3/users/ca21fc99f82149b2a23a846e80caa95e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:20.922344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca21fc99f82149b2a23a846e80caa95e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:20.924392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:20.983152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca21fc99f82149b2a23a846e80caa95e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:20.995897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca21fc99f82149b2a23a846e80caa95e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:20.996641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca21fc99f82149b2a23a846e80caa95e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:20.997283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca21fc99f82149b2a23a846e80caa95e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.005380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca21fc99f82149b2a23a846e80caa95e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.019209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1072/2112] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:20 2022] DELETE /identity/v3/users/ca21fc99f82149b2a23a846e80caa95e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:21.023874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:21.024107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:21.024390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:21.046512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:21.048243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:21.117527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1041/2113] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:21.124503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:21.126187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:21.237520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6727-e21b-4305-9125-202ed1b8efd4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:21.246341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:21.247265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:21.247853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:21.248346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:21.259271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:21.262096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:21.273716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1073/2114] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:21.763337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:21.765273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:21.785540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba09661-2da6-4839-931e-9f54f8a235f0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:21.800729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:21.801806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:21.802215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:21.802387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] PATH_INFO: `/v3/projects/d870647d574d42368a76fadd59025898` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:21.803817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d870647d574d42368a76fadd59025898)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:21.805862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:21.868237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd870647d574d42368a76fadd59025898', 'request_id': 'req-133a99a9-195d-4be5-982e-a5211769cf07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.875572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd870647d574d42368a76fadd59025898', 'request_id': 'req-133a99a9-195d-4be5-982e-a5211769cf07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.881871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd870647d574d42368a76fadd59025898', 'request_id': 'req-133a99a9-195d-4be5-982e-a5211769cf07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.896631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] The token cache is being invalidate because project d870647d574d42368a76fadd59025898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:21.897009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.897783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:21.899654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1042/2115] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:21 2022] DELETE /identity/v3/projects/d870647d574d42368a76fadd59025898 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:21.903594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:21.918022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ba40-bf2b-4c2a-a002-aee5ddb2be57 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:21.983426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:21.984808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:21.985297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:21.985899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] PATH_INFO: `/v3/users/62281b3c09704007aab628da8df13fb2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:21.987280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62281b3c09704007aab628da8df13fb2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:21.989545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:22.043050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62281b3c09704007aab628da8df13fb2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.057945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62281b3c09704007aab628da8df13fb2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.059414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62281b3c09704007aab628da8df13fb2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.060227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62281b3c09704007aab628da8df13fb2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.070186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e2bd31ba-664c-47f2-be28-aed495a57e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62281b3c09704007aab628da8df13fb2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.083932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1074/2116] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:21 2022] DELETE /identity/v3/users/62281b3c09704007aab628da8df13fb2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:22.397889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:22.403659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:22.442037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a99a9-195d-4be5-982e-a5211769cf07 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:22.564029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:22.565183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:22.565656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:22.566100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] PATH_INFO: `/v3/projects/e6d44ebf930248eea954d14f677f112d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:22.568009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d44ebf930248eea954d14f677f112d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:22.570314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:22.647371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d44ebf930248eea954d14f677f112d', 'request_id': 'req-dae8c21b-977c-4066-8d4d-3462f43da041'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.655556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d44ebf930248eea954d14f677f112d', 'request_id': 'req-dae8c21b-977c-4066-8d4d-3462f43da041'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.664327 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d44ebf930248eea954d14f677f112d', 'request_id': 'req-dae8c21b-977c-4066-8d4d-3462f43da041'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.690740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] The token cache is being invalidate because project e6d44ebf930248eea954d14f677f112d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:22.691068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.691846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dae8c21b-977c-4066-8d4d-3462f43da041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:22.694939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1043/2117] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:22 2022] DELETE /identity/v3/projects/e6d44ebf930248eea954d14f677f112d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:22.700882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:22.702499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:22.702499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:22.726331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:22.727630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:22.822115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1075/2118] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:22.825097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:22.825578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:22.825868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:22.851457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:22.852670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:22.866415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1044/2119] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:22.871557 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:22.882371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052ca8a-1f51-456c-b614-775f673143fb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:22.887548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:22.888221 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:22.888537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:22.888822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:22.889926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:22.890059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:22.891967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:22.917797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1076/2120] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 05:59:22.922954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:22.936334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43916-0336-4062-a092-33b6935f9308 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:22.942763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:22.944091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:22.944294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:22.944569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:22.945317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:22.947470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:22.977861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1045/2121] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:22 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:22.981929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:22.993235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567954e3-bbad-4bd3-88a2-276bfd386b33 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:23.063648 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:23.064604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.065044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.065332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.066094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:23.068270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:23.093255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1077/2122] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:22 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:23.096984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:23.134679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9eef3-7e01-47b3-8ab3-01f1519a0356 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:23.143181 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:23.144963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.145359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.146817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.148517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:23.153494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:23.178373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1046/2123] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:23.179473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:23.199234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9cd3-7371-4f3c-bc4c-00baabc8f2ba admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:23.205302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:23.206357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.206859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.207368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.208319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:23.210222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291bec-1cda-4b32-8efa-82bd941a1f83 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:23.224993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1078/2124] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:23.229702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:23.251616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd671-e58e-4b0a-984a-281bdd692266 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:23.258833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:23.259852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.260781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.261142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] PATH_INFO: `/v3/projects/daf8e8e1a9b24ef2a6063273f736c9c5/users/b1d85e4587054602b88159f2622fbf25/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.293130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf8e8e1a9b24ef2a6063273f736c9c5, user_id=b1d85e4587054602b88159f2622fbf25, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:23.299427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:23.326621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1047/2125] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:23 2022] PUT /identity/v3/projects/daf8e8e1a9b24ef2a6063273f736c9c5/users/b1d85e4587054602b88159f2622fbf25/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 05:59:23.328978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11024f8-515f-43f2-96bb-e33b58db6baa None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.329657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11024f8-515f-43f2-96bb-e33b58db6baa None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.329995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11024f8-515f-43f2-96bb-e33b58db6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.360187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e11024f8-515f-43f2-96bb-e33b58db6baa None None] MFA Rules not processed for user `b1d85e4587054602b88159f2622fbf25`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:23.361666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e11024f8-515f-43f2-96bb-e33b58db6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:23.442386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1079/2126] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 05:59:23.460132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:23.464343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:23.538733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720ba4-10e5-46ec-965c-89f559ce4c3e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:23.547199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:23.547994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:23.548955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:23.549446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:23.561120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:23.563841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:23.583800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1048/2127] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:27.328772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:27.329352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:27.329442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:27.365218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] MFA Rules not processed for user `97d51f046add49a9a991b55cbede2e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:27.366606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:27.453634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1080/2128] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:27.460456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:27.461926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:27.563847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b908fc-3216-4470-8ce4-16c8f647b97a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:27.575394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:27.576578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:27.577162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:27.577704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:27.579950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:27.664833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:27.666520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f4187-2cc3-492a-a059-e8386ba585ff service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:27.677622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1049/2129] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:41.951310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:41.953092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.025703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c01a3-a808-437d-b59b-c843813a0156 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:42.030216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:42.031333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.031800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.032086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] PATH_INFO: `/v3/users/f21fdc5e01e84a8295987994d2b5e672` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.034326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21fdc5e01e84a8295987994d2b5e672)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:42.036662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:42.088774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21fdc5e01e84a8295987994d2b5e672'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.104710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21fdc5e01e84a8295987994d2b5e672'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.105624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21fdc5e01e84a8295987994d2b5e672'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.106388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21fdc5e01e84a8295987994d2b5e672'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.114771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21fdc5e01e84a8295987994d2b5e672'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.134958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1081/2130] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 05:59:41 2022] DELETE /identity/v3/users/f21fdc5e01e84a8295987994d2b5e672 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:42.139761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.140293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.140591 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.162103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:42.163596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.231338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1050/2131] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:42.241854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:42.243659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.311269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18040-dcda-4cf7-961b-1020e176f651 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:42.314782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:42.315426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.315704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.315981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.325172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:42.327170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556300e-ea7e-4029-9d22-4dd865e04d3e service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:42.337125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1082/2132] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:42.673783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:42.675206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.688396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3dcc-fd06-4233-a6f3-cf089b056001 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:42.695098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:42.696212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.696599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.696997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] PATH_INFO: `/v3/projects/fe53acd4a77d48058873e3bae24bd47b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.698341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe53acd4a77d48058873e3bae24bd47b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:42.701010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:42.764027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe53acd4a77d48058873e3bae24bd47b', 'request_id': 'req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.769773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe53acd4a77d48058873e3bae24bd47b', 'request_id': 'req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.775960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe53acd4a77d48058873e3bae24bd47b', 'request_id': 'req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.788635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] The token cache is being invalidate because project fe53acd4a77d48058873e3bae24bd47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 05:59:42.788964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.789623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b88a3a45-cdf1-422d-a249-b1c1c7b6bbc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 05:59:42.793546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1051/2133] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 05:59:42 2022] DELETE /identity/v3/projects/fe53acd4a77d48058873e3bae24bd47b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:42.796879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.797188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.797444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.818827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:42.820044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.884014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1083/2134] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:42.892890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.893188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.893552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.912151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:42.913374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:42.922997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1052/2135] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:42.927666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:42.938394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e68c53-477e-42e5-ad24-6ba8304f6594 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:42.943304 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:42.944001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.944280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.944560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.945294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 05:59:42.945653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:42.947252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:42.959562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1084/2136] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 05:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 05:59:42.964050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:42.973546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e1a13-859c-4436-9058-5fa03ef271a6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:42.978146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:42.978797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:42.979081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:42.979356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:42.980046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:42.982575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.008318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1053/2137] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 05:59:42 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 05:59:43.012495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:43.022547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143bc1-d9a9-4f72-8375-cf5b3a6d4e4a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:43.081914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:43.082592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.082882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.083165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.083866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:43.085818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.109291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1085/2138] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 05:59:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 05:59:43.112387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:43.123971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213beca-d1cb-473d-b59c-7203c11d4a9a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:43.129401 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:43.130288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.130579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.130895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.131608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:43.133281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.145215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1054/2139] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 05:59:43.149355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:43.161062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457dd8-40f0-4a72-a73f-deb58941458a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:43.165790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:43.166450 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.166738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.167014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.167739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:43.169615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfa46-e5a7-4d56-b84f-145f01b9551d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.179767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1086/2140] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 05:59:43.185320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:43.198200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca384-5fa6-4906-aa5b-9bda11679298 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:43.203669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:43.204548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.204828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.205104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] PATH_INFO: `/v3/projects/3a889575293f48af826e9734868e2714/users/c054038efc2741ba951666abb68e1cf7/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.219770 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a889575293f48af826e9734868e2714, user_id=c054038efc2741ba951666abb68e1cf7, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:43.222661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.236479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1055/2141] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 05:59:43 2022] PUT /identity/v3/projects/3a889575293f48af826e9734868e2714/users/c054038efc2741ba951666abb68e1cf7/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 05:59:43.241538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a98b-9a74-47aa-8c4f-e452bb85fe95 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.241917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a98b-9a74-47aa-8c4f-e452bb85fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.242209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a98b-9a74-47aa-8c4f-e452bb85fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.262220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-28e5a98b-9a74-47aa-8c4f-e452bb85fe95 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:43.264043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-28e5a98b-9a74-47aa-8c4f-e452bb85fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:43.327238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1087/2142] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:43.337060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:43.339853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:43.419305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cd96-4ca2-462c-aa18-bc313e284567 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:43.423041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:43.423689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:43.423990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:43.424251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:43.433403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:43.435489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:43.446476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1056/2143] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:44.163607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697c9b7-8e98-41be-a3d5-15bb3e81ba4f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:44.164217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697c9b7-8e98-41be-a3d5-15bb3e81ba4f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:44.164217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697c9b7-8e98-41be-a3d5-15bb3e81ba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:44.197629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f697c9b7-8e98-41be-a3d5-15bb3e81ba4f None None] MFA Rules not processed for user `c054038efc2741ba951666abb68e1cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:44.198835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f697c9b7-8e98-41be-a3d5-15bb3e81ba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:44.266773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1088/2144] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:44.278025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:44.280098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:44.339701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8619-86c9-4e1b-a14e-de168fe495d5 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:44.345695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:44.346392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:44.346684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:44.347057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:44.357965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:44.359564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:44.369359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1057/2145] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:45.735405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea701d-9aa3-4c55-b5d2-817686e39aef None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:45.735963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea701d-9aa3-4c55-b5d2-817686e39aef None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:45.735963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea701d-9aa3-4c55-b5d2-817686e39aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:45.766334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d4ea701d-9aa3-4c55-b5d2-817686e39aef None None] MFA Rules not processed for user `c054038efc2741ba951666abb68e1cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:45.767560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d4ea701d-9aa3-4c55-b5d2-817686e39aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:45.791368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1089/2146] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 05:59:48.712944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 05:59:48.754306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90615-8196-4714-89c7-bac71bba6bb4 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 05:59:48.758683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 05:59:48.759433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:48.759812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:48.760797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:48.763409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:48.838566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 05:59:48.840094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb43678-ddaa-462c-8133-20fad92957d4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 05:59:48.850173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1058/2147] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 05:59:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 05:59:57.892387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872f3e8-0d13-4230-9138-592921a03982 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 05:59:57.892942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872f3e8-0d13-4230-9138-592921a03982 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 05:59:57.892942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872f3e8-0d13-4230-9138-592921a03982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 05:59:57.910929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3872f3e8-0d13-4230-9138-592921a03982 None None] MFA Rules not processed for user `4892d58f399a44b485514cb29f2259b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 05:59:57.912132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3872f3e8-0d13-4230-9138-592921a03982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 05:59:57.989893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1090/2148] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 05:59:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:01.308527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbb00-4b63-4a07-ab29-67e4d195e6d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:01.309882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbb00-4b63-4a07-ab29-67e4d195e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:01.309988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbb00-4b63-4a07-ab29-67e4d195e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:01.333352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8d7bbb00-4b63-4a07-ab29-67e4d195e6d3 None None] MFA Rules not processed for user `bbc14e1f89334e65b24fec7b4a321c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:01.334774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d7bbb00-4b63-4a07-ab29-67e4d195e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:01.436969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1059/2149] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:12.480025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:12.481279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:12.481742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:12.502937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] MFA Rules not processed for user `28c76d12b0b1436d8eb0b23acf252f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:12.504255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:12.574276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1091/2150] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:12.920398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:12.920916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:12.921010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:12.960078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:12.961452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:13.047908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1060/2151] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:00:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:13.101782 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:13.104664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:13.181854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea07f3-1e85-4a0d-9f48-a4435a192274 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:13.186798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:13.187591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:13.188030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:13.188317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:13.196807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:13.198420 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ac168-d4fe-4e8c-bd40-7d7a7db3957a service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:13.206628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1092/2152] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:00:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:00:13.714011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:13.716558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:13.812259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c354-6d3c-48c9-8905-3ee2390f3d5f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:13.818003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:13.819263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:13.819812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:13.822596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] PATH_INFO: `/v3/users/b1d85e4587054602b88159f2622fbf25` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:13.824421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d85e4587054602b88159f2622fbf25)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:13.827461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:13.913267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d85e4587054602b88159f2622fbf25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:13.942747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d85e4587054602b88159f2622fbf25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:13.952370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d85e4587054602b88159f2622fbf25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:13.953336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d85e4587054602b88159f2622fbf25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:13.954354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d85e4587054602b88159f2622fbf25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:13.983917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1061/2153] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:00:13 2022] DELETE /identity/v3/users/b1d85e4587054602b88159f2622fbf25 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:00:13.989095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:13.989641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:13.990091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:14.036409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:14.038133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:14.174998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1093/2154] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:14.200925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:14.202493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:14.346006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1013-ed62-42c5-8f7f-ab9e6119f9b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:14.350055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:14.350814 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:14.351111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:14.351398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:14.363964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:14.365903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e8025-07cb-40fb-83ab-610546b36e38 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:14.392655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1062/2155] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:14.989177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:14.995930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:15.017786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0253e-ae81-4129-a993-8274e7e947de None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.023439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.024600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.025002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.025340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] PATH_INFO: `/v3/projects/daf8e8e1a9b24ef2a6063273f736c9c5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.026710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf8e8e1a9b24ef2a6063273f736c9c5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.029565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.088760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf8e8e1a9b24ef2a6063273f736c9c5', 'request_id': 'req-764c1387-37d5-4bda-a9d2-eae765eaaf38'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:15.096170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf8e8e1a9b24ef2a6063273f736c9c5', 'request_id': 'req-764c1387-37d5-4bda-a9d2-eae765eaaf38'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:15.111069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf8e8e1a9b24ef2a6063273f736c9c5', 'request_id': 'req-764c1387-37d5-4bda-a9d2-eae765eaaf38'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:15.126079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] The token cache is being invalidate because project daf8e8e1a9b24ef2a6063273f736c9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:00:15.126743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:15.127460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-764c1387-37d5-4bda-a9d2-eae765eaaf38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:15.132573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1094/2156] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:00:14 2022] DELETE /identity/v3/projects/daf8e8e1a9b24ef2a6063273f736c9c5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:00:15.134535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.135062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.135437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.199704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:15.200953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:15.299095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1063/2157] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:15.307081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.307261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.307543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.327423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:15.328975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:15.346281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1095/2158] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:00:15.350496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.366250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1cfb-2e04-4d1a-a877-c2ba91e68307 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.372373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.373611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.374062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.374509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.375251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:00:15.375702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.377536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.394060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1064/2159] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:00:15.399524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.420956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad992-2f7b-4d39-aacb-eb5efd4df6df None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.440029 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.440787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.443997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.444681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.445698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.452589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.518177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1096/2160] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:00:15.521567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.551220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fecfd3-08b8-4650-9a57-e1e240e06e66 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.638093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.638874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.639188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.639478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.640261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.642861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.674406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1065/2161] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:00:15 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:00:15.678287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.694012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d3ef-429d-4afe-bfed-4f1fe452ffd5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.706430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.707455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.708631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.709093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.710124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.712021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.730719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1097/2162] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:00:15.733530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.750402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803ab87-6331-4688-b4f9-a5179af9aa16 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.755738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.756615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.756903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.757240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.758131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.760225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbba47-b1d7-4e9e-881e-ad7619e3b3e0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:15.826844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1066/2163] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:00:15.830492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:15.884034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d082f51-d8bb-40c3-874d-1bf3b75992e7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:15.916813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:15.918598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:15.919350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:15.922342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] PATH_INFO: `/v3/projects/c6222cdbf6ea4a64b5d4cf12774a77f3/users/5fe7819e3e394167bd375c1cd4e2d906/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:15.987836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6222cdbf6ea4a64b5d4cf12774a77f3, user_id=5fe7819e3e394167bd375c1cd4e2d906, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:15.991644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:16.023246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1098/2164] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:00:15 2022] PUT /identity/v3/projects/c6222cdbf6ea4a64b5d4cf12774a77f3/users/5fe7819e3e394167bd375c1cd4e2d906/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:00:16.033900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:16.034268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:16.034737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:16.115669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] MFA Rules not processed for user `5fe7819e3e394167bd375c1cd4e2d906`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:16.118445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:16.274070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1067/2165] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:16.285646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:16.289934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:16.421308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac2d0-6341-465a-aa7c-4ba709098063 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:16.431279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:16.432265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:16.432797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:16.432797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:16.443388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:16.445051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e6a91-e1d5-42fe-b839-32b592954a04 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:16.488257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1099/2166] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:28.443090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:28.505568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a96f8-eb86-4111-aff5-1cb8a49c6dd9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:28.510502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:28.512021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:28.512484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:28.512765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] PATH_INFO: `/v3/users/5fe7819e3e394167bd375c1cd4e2d906` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:28.513997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe7819e3e394167bd375c1cd4e2d906)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:28.516202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:28.560414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe7819e3e394167bd375c1cd4e2d906'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:28.572290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe7819e3e394167bd375c1cd4e2d906'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:28.582192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe7819e3e394167bd375c1cd4e2d906'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:28.582953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe7819e3e394167bd375c1cd4e2d906'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:28.583579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe7819e3e394167bd375c1cd4e2d906'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:28.598149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1068/2167] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:00:28 2022] DELETE /identity/v3/users/5fe7819e3e394167bd375c1cd4e2d906 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:00:28.602855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:28.602855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:28.603452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:28.623475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:28.624683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:28.684430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1100/2168] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:28.694798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:28.696353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:28.755467 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511386-4d0f-40a9-8b2a-decdbca77f23 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:28.759153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:28.759809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:28.760099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:28.760382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:28.769910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:28.771355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1e4b1-aaaf-42c6-a461-190d3f717ae4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:28.780905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1069/2169] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:29.114579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.117077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:29.130425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c0525-4c1a-4f0f-a9f3-95b9ba31aa92 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.143992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.145225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.145605 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.146101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] PATH_INFO: `/v3/projects/c6222cdbf6ea4a64b5d4cf12774a77f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.147714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6222cdbf6ea4a64b5d4cf12774a77f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.149772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.216779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6222cdbf6ea4a64b5d4cf12774a77f3', 'request_id': 'req-1efc45f5-9f66-4865-8984-56e55c461a1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:29.222830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6222cdbf6ea4a64b5d4cf12774a77f3', 'request_id': 'req-1efc45f5-9f66-4865-8984-56e55c461a1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:29.232932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6222cdbf6ea4a64b5d4cf12774a77f3', 'request_id': 'req-1efc45f5-9f66-4865-8984-56e55c461a1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:29.246109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] The token cache is being invalidate because project c6222cdbf6ea4a64b5d4cf12774a77f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:00:29.246472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:29.249902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1efc45f5-9f66-4865-8984-56e55c461a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:00:29.251930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1101/2170] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:00:29 2022] DELETE /identity/v3/projects/c6222cdbf6ea4a64b5d4cf12774a77f3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:00:29.256541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.256836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.257126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.275950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:29.280739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:29.343977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1070/2171] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:29.351810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.352111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.352394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.371156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:29.372379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:29.380351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1102/2172] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:29.384436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.396281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274bfa-5408-4de9-9043-701e9e8e0274 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.400906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.401681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.403250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.403535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.404269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:00:29.404586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.406225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.417904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1071/2173] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:00:29.422092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.431159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a634b-573e-42e3-8eb9-2a20da688343 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.436110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.436854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.437242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.437638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.438398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.440379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.470451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1103/2174] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:00:29 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:00:29.473906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.483760 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb8b8b-4b11-44a5-a55e-caad8cc1db87 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.539939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.540608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.540915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.541183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.541939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.544406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.564617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1072/2175] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:00:29 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:00:29.568563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.579177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd843483-9de9-475c-9df7-3edbc4f8f681 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.583958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.584612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.584901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.585180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.585949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.587544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.598649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1104/2176] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:00:29.602562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.613521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a1cb-b20e-4754-971a-cce38e053f26 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.618151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.618805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.619094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.619376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.620098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.622268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22affef0-9355-4bb5-a852-f5e0250b6acf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.631917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1073/2177] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:00:29.636066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.646667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84f58-b956-47bb-ba6c-afeb386cbf59 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.651503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.652573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.652865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.653151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] PATH_INFO: `/v3/projects/982a5299d6f241bc931c9ef14945bcd9/users/d9c5c2eea36846eb831c091bb2c90b17/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.667512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982a5299d6f241bc931c9ef14945bcd9, user_id=d9c5c2eea36846eb831c091bb2c90b17, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.670341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.684743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1105/2178] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:00:29 2022] PUT /identity/v3/projects/982a5299d6f241bc931c9ef14945bcd9/users/d9c5c2eea36846eb831c091bb2c90b17/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:00:29.695550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd7f3-6fb5-4f9e-ba23-1deee7b952a8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.695849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd7f3-6fb5-4f9e-ba23-1deee7b952a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.696133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd7f3-6fb5-4f9e-ba23-1deee7b952a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.722747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-543fd7f3-6fb5-4f9e-ba23-1deee7b952a8 None None] MFA Rules not processed for user `d9c5c2eea36846eb831c091bb2c90b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:29.723882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-543fd7f3-6fb5-4f9e-ba23-1deee7b952a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:29.789513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1074/2179] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:29.800242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:29.801981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:29.858431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14396fc-d332-4cdf-81a9-85cf69f6a3a8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:29.862088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:29.862732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:29.863019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:29.863295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:29.872446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:29.873960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:29.883271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1106/2180] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:31.221410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584372c-0835-4638-bf39-4b1002d58744 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:31.221964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584372c-0835-4638-bf39-4b1002d58744 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:31.222080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584372c-0835-4638-bf39-4b1002d58744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:31.239194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b584372c-0835-4638-bf39-4b1002d58744 None None] MFA Rules not processed for user `d9c5c2eea36846eb831c091bb2c90b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:31.240478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b584372c-0835-4638-bf39-4b1002d58744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:31.252388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1075/2181] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:32.106977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:32.108747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:32.175195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53de0-bcbc-4234-a3c5-4407b82b84a8 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:32.179134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:32.179939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:32.180255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:32.180602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:32.182707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:32.267872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:32.269356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02489115-8789-4fbe-8772-92f2d49142b2 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:32.279784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1107/2182] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:37.929732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:37.930374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:37.930495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:37.932270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1076/2183] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 06:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:00:37.953404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e163-f4fd-45bb-b742-2a53573ab1b9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:37.953930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e163-f4fd-45bb-b742-2a53573ab1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:37.954014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e163-f4fd-45bb-b742-2a53573ab1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.019687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0931e163-f4fd-45bb-b742-2a53573ab1b9 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:38.021072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0931e163-f4fd-45bb-b742-2a53573ab1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:38.131766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1108/2184] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 06:00:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:38.146638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:38.149310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:38.242106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e136b3-76a8-4c25-8c21-8a5b38642d4f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:38.246689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:38.247418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.247758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.248212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.259601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:38.262144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32116bb0-4b8b-4394-b8fd-74b5f6f3795a service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:38.286047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1077/2185] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:38.375990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ff6c-41ac-49f3-a52f-80c066a82328 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.376280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ff6c-41ac-49f3-a52f-80c066a82328 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.376562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ff6c-41ac-49f3-a52f-80c066a82328 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.378479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1109/2186] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 06:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:00:38.384733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab7ff5-50a6-4631-8cdc-f39a330b6816 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.385050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab7ff5-50a6-4631-8cdc-f39a330b6816 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.385394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab7ff5-50a6-4631-8cdc-f39a330b6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.420877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5dab7ff5-50a6-4631-8cdc-f39a330b6816 None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:38.422177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5dab7ff5-50a6-4631-8cdc-f39a330b6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:38.429889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1078/2187] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:00:38.442228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6ff6c-41ac-49f3-a52f-80c066a82328 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:38.457779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6ff6c-41ac-49f3-a52f-80c066a82328 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:38.461772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:38.462422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.462708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.462989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.471113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:38.472565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fa15-b156-4bbd-8bb5-2ec1dff4e813 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:38.481712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1110/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:00:38.576232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34929694-54ab-4f16-bda2-b01775ba82e5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.576563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34929694-54ab-4f16-bda2-b01775ba82e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.576857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34929694-54ab-4f16-bda2-b01775ba82e5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.584283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.584572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.584853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.584994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1079/2189] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 06:00:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:00:38.606695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:00:38.608167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:00:38.619804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1111/2190] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:00:38.631392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34929694-54ab-4f16-bda2-b01775ba82e5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:00:38.644619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34929694-54ab-4f16-bda2-b01775ba82e5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:00:38.648415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:00:38.649091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:00:38.649381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:00:38.649702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:00:38.661361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:00:38.662859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e7521-fe2f-406b-a56b-f99ad381175d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:00:38.675387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1080/2191] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:00:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:01:03.172209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:03.178714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:03.285579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ab45-3ea8-42c7-93fa-2b1d46bba9b4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:03.290595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:03.291247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:03.291536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:03.292439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:03.294587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:03.306801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:03.308952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:03.318848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1112/2192] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:01:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:01:03.872154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213e95d-4dcb-4c7c-b5f3-7f971cbfca6f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:03.872583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213e95d-4dcb-4c7c-b5f3-7f971cbfca6f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:03.872715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213e95d-4dcb-4c7c-b5f3-7f971cbfca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:03.931515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a213e95d-4dcb-4c7c-b5f3-7f971cbfca6f None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:03.933239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a213e95d-4dcb-4c7c-b5f3-7f971cbfca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:04.000976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1081/2193] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:04.013797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:04.015200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:04.112550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15175b4-a312-4adf-8b17-cac1ceac9884 service placement] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:04.118117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:04.118755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:04.119038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:04.119311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:04.134684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:04.137875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:04.149223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1113/2194] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:01:20.834905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd5ae-a5ae-4a1f-bb22-7b85f81f7e36 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:20.835535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd5ae-a5ae-4a1f-bb22-7b85f81f7e36 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:20.835971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd5ae-a5ae-4a1f-bb22-7b85f81f7e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:20.854606 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-06fdd5ae-a5ae-4a1f-bb22-7b85f81f7e36 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:20.856761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06fdd5ae-a5ae-4a1f-bb22-7b85f81f7e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:20.865365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1082/2195] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:01:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:20.889231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:20.899810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdaf68-ffe5-4bbd-86d9-2c74390b26b0 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:20.905426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:20.906189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:20.906474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:20.906753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:20.914775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:20.916349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:20.924238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1114/2196] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:01:21.512186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5adc-a966-4da8-9064-7e7e7d2d8b6f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:21.512472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5adc-a966-4da8-9064-7e7e7d2d8b6f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:21.512753 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5adc-a966-4da8-9064-7e7e7d2d8b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:21.532147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0dbb5adc-a966-4da8-9064-7e7e7d2d8b6f None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:21.533720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0dbb5adc-a966-4da8-9064-7e7e7d2d8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:21.541492 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1083/2197] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:21.555177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:21.571179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715ee9-8eb7-4a7e-816b-5cecad6cb966 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:21.576471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:21.577118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:21.577402 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:21.577723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:21.586667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:21.588253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:21.596694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1115/2198] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:01:21.818821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80e63-0625-4b4b-9235-b44edb3965f4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:21.819118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80e63-0625-4b4b-9235-b44edb3965f4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:21.819406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80e63-0625-4b4b-9235-b44edb3965f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:21.837636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7cc80e63-0625-4b4b-9235-b44edb3965f4 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:21.838845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7cc80e63-0625-4b4b-9235-b44edb3965f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:21.846705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1084/2199] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:21.858635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:21.868974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497766-b116-4aa2-aa35-beae67c03eb8 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:21.874059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:21.874746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:21.875033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:21.875315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:21.883547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:21.885142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:21.894048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1116/2200] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:01:22.206111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:22.206406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:22.206690 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:22.224438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:22.225682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:22.232693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1085/2201] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:01:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:22.244385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:22.255595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5f222-529c-4b73-b5bd-7fec8c5e84eb service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:22.260553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:22.262009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:22.262294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:22.262573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:22.270509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:22.272213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3fa1d-0b61-4e3c-ae3c-73bdb1046985 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:22.279886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1117/2202] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:01:24.457004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:24.519734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede48ea-435e-458b-9709-a64f3ac096d4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:24.524227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:24.525095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:24.525378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:24.525686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] PATH_INFO: `/v3/users/d9c5c2eea36846eb831c091bb2c90b17` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:24.527455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c5c2eea36846eb831c091bb2c90b17)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:24.529384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:24.578850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c5c2eea36846eb831c091bb2c90b17'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:24.592235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c5c2eea36846eb831c091bb2c90b17'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:24.598733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c5c2eea36846eb831c091bb2c90b17'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:24.599430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c5c2eea36846eb831c091bb2c90b17'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:24.600035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c5c2eea36846eb831c091bb2c90b17'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:24.613041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1086/2203] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:01:24 2022] DELETE /identity/v3/users/d9c5c2eea36846eb831c091bb2c90b17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:01:24.617562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:24.618041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:24.618150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:24.635999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:24.637209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:24.695425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1118/2204] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:24.709234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:24.710685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:24.767515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b71fd-3f2c-4e4b-b89e-8dbae3ae6f83 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:24.771321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:24.771974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:24.772290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:24.772574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:24.782375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:24.783802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d45ef-68b5-4c09-b7ce-426f749e0f1c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:24.793747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1087/2205] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:01:25.006102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.007767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:25.021894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98cde1-ea04-4172-bacd-500292598d41 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.027398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.028517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.028800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.029248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] PATH_INFO: `/v3/projects/982a5299d6f241bc931c9ef14945bcd9` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.030676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] RBAC: Authorizing `identity:delete_project(project_id=982a5299d6f241bc931c9ef14945bcd9)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.032601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.077526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982a5299d6f241bc931c9ef14945bcd9', 'request_id': 'req-867b7e90-43b9-4605-817b-6021ab0e544e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:25.082724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982a5299d6f241bc931c9ef14945bcd9', 'request_id': 'req-867b7e90-43b9-4605-817b-6021ab0e544e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:25.090825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982a5299d6f241bc931c9ef14945bcd9', 'request_id': 'req-867b7e90-43b9-4605-817b-6021ab0e544e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:25.101685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] The token cache is being invalidate because project 982a5299d6f241bc931c9ef14945bcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:01:25.101973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:25.102597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-867b7e90-43b9-4605-817b-6021ab0e544e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:25.104117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1119/2206] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:01:25 2022] DELETE /identity/v3/projects/982a5299d6f241bc931c9ef14945bcd9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:01:25.109346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.109689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.109976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.128440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:25.129663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:25.187843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1088/2207] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:25.194967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.195332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.195614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.214805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:25.215993 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:25.223909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1120/2208] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:01:25.227937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.237254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b070e9-10b1-445f-aa27-c95273598985 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.241746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.242412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.242696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.242990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.243688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:01:25.243993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.246287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.257318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1089/2209] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:01:25.262008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.271131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb36518-7cf7-4ba4-886d-e2baa072a043 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.275753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.276433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.276711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.276989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.277725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.279646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.303466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1121/2210] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:01:25 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:01:25.308105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.317996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1cedf-a126-4d7b-89db-e2309c5fe975 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.371366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.372015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.372299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.372577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.373264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.375204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.394633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1090/2211] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:01:25 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:01:25.398577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.408772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3020ad1-f7f9-4c81-912e-e2b975e34a3f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.413315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.414002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.414284 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.414558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.415267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.416878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.426953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1122/2212] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:01:25.430692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.440956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14aa2c-a204-475f-ad11-162bffab8ca6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.445522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.446167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.446452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.446731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.447447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.449604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862c0d8-52f2-4665-8084-c0cf525a72ac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.459388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1091/2213] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:01:25.463212 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.472929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f269e0-9958-49a8-99b5-73bd7065f87b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.477481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.478360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.478635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.478903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] PATH_INFO: `/v3/projects/f5b26f94c7b242f6a4071082d9687830/users/1f42bc4354524ed4af09b5da8f49055b/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.494371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b26f94c7b242f6a4071082d9687830, user_id=1f42bc4354524ed4af09b5da8f49055b, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.497691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.509817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1123/2214] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:01:25 2022] PUT /identity/v3/projects/f5b26f94c7b242f6a4071082d9687830/users/1f42bc4354524ed4af09b5da8f49055b/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:01:25.520221 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c8291-d8de-408b-b1f2-4ab687fce4e0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.520518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c8291-d8de-408b-b1f2-4ab687fce4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.520800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c8291-d8de-408b-b1f2-4ab687fce4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.547379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-582c8291-d8de-408b-b1f2-4ab687fce4e0 None None] MFA Rules not processed for user `1f42bc4354524ed4af09b5da8f49055b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:25.548584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-582c8291-d8de-408b-b1f2-4ab687fce4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:25.610861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1092/2215] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:25.623052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:25.624779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:25.680176 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6b4f-bdd7-4dcd-85f4-534c07ecca9a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:25.684936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:25.685608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:25.685889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:25.686163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:25.694720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:25.696154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dd8c0-e230-44ad-b43f-f727e7bf5194 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:25.705095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1124/2216] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:01:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:01:45.155384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:45.156007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:45.156007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:45.174387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] MFA Rules not processed for user `c054038efc2741ba951666abb68e1cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:45.175612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:45.231886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1093/2217] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:46.105976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:46.106743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:46.106743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:46.124821 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:46.126045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:46.194177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1125/2218] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:01:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:46.208655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:46.210772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:46.289342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849b9b1-8a2f-4161-878e-46923a38c266 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:46.295830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:46.296489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:46.296790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:46.297064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:46.305778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:46.307470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ccbb2-5989-465f-8252-5dee0ac44e1f service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:46.316774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1094/2219] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:01:48.072278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:48.134698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074ca73-3566-4576-85fd-d5b5c4ed9112 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:48.139664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:48.140539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:48.141092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:48.141374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] PATH_INFO: `/v3/users/1f42bc4354524ed4af09b5da8f49055b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:48.143194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f42bc4354524ed4af09b5da8f49055b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:48.144536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:48.194827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f42bc4354524ed4af09b5da8f49055b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.206883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f42bc4354524ed4af09b5da8f49055b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.207949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f42bc4354524ed4af09b5da8f49055b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.208812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f42bc4354524ed4af09b5da8f49055b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.218763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f42bc4354524ed4af09b5da8f49055b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.232514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1126/2220] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:01:48 2022] DELETE /identity/v3/users/1f42bc4354524ed4af09b5da8f49055b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:01:48.238758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:48.238758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:48.238758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:48.256369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:48.257599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:48.317984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1095/2221] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:01:48.327392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:48.328820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:48.386130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205ae5-4725-4143-a821-53f329f9e272 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:48.390693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:48.391604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:48.391888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:48.392428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:48.403736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:48.405290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890dd94-2941-4e98-a025-aa405b207615 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:48.421812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1127/2222] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:01:48.836686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:48.838368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:48.852321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c15e-51ec-48e2-b9af-746628cd04bd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:48.858038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:48.858913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:48.859195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:48.859661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] PATH_INFO: `/v3/projects/f5b26f94c7b242f6a4071082d9687830` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:48.860970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b26f94c7b242f6a4071082d9687830)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:48.862861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:48.912623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b26f94c7b242f6a4071082d9687830', 'request_id': 'req-0e51bcd2-6a5a-4d4c-a893-12934caa3483'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.917972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b26f94c7b242f6a4071082d9687830', 'request_id': 'req-0e51bcd2-6a5a-4d4c-a893-12934caa3483'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.924050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b26f94c7b242f6a4071082d9687830', 'request_id': 'req-0e51bcd2-6a5a-4d4c-a893-12934caa3483'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.936892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] The token cache is being invalidate because project f5b26f94c7b242f6a4071082d9687830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:01:48.937305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.938106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0e51bcd2-6a5a-4d4c-a893-12934caa3483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:01:48.939685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1096/2223] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:01:48 2022] DELETE /identity/v3/projects/f5b26f94c7b242f6a4071082d9687830 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:01:48.945140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:48.945413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:48.945758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:48.963590 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:48.965555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:49.031451 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1128/2224] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:49.040394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.040686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.040998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.059653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:49.060862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:49.069064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1097/2225] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:49.073200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.084311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f52f66-13f5-4925-ba23-2039b45c04bd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.090179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.090902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.091186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.091489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.092219 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:01:49.092524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.094183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.107726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1129/2226] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:01:49.111978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.122015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f208cb-d79e-42e5-ad21-c1d1396945c4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.126712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.127388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.127740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.128026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.128731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.130735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.159183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1098/2227] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:01:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:01:49.163436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.173870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ce05-495e-43b4-be69-cf78fa585278 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.234539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.235227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.235509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.235788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.236485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.238466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.259502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1130/2228] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:01:49 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:01:49.264337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.275037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c47403-031e-4d6a-8417-ea285dc773fc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.279963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.280647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.280937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.281217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.282119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.283746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.295178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1099/2229] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:01:49.299185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.310140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713abc6-c6aa-4229-b730-aa30711c513b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.314885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.315548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.315832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.316110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.316838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.318502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3191dc-5065-4903-8cb1-1eaf1ac35ff0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.329456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1131/2230] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:01:49.333732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.343716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08dfb5-de02-4c61-b8fc-7537d5a926a8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.348305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.349230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.349539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.349819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] PATH_INFO: `/v3/projects/3071f6c8fd64408fa45be4bc3a5c3f4d/users/70d3a9e2d0a14433a9a8627d15b07ff1/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.365798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3071f6c8fd64408fa45be4bc3a5c3f4d, user_id=70d3a9e2d0a14433a9a8627d15b07ff1, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.368700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.382313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1100/2231] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:01:49 2022] PUT /identity/v3/projects/3071f6c8fd64408fa45be4bc3a5c3f4d/users/70d3a9e2d0a14433a9a8627d15b07ff1/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:01:49.387974 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249fa5-51eb-4698-9cf4-f6c3a0f2bfba None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.388263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249fa5-51eb-4698-9cf4-f6c3a0f2bfba None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.388592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1249fa5-51eb-4698-9cf4-f6c3a0f2bfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.406694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a1249fa5-51eb-4698-9cf4-f6c3a0f2bfba None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:49.407902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a1249fa5-51eb-4698-9cf4-f6c3a0f2bfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:49.466351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1132/2232] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:01:49.475475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:49.477201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:49.532247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e136704-3fbf-4b9c-bd2f-bac824955b6d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:49.535729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:49.536362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:49.536644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:49.536920 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:49.546091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:49.547502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:49.556597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1101/2233] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:01:54.896758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:54.897311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:54.897516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:54.930852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] MFA Rules not processed for user `70d3a9e2d0a14433a9a8627d15b07ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:54.932077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:55.005725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1133/2234] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:01:55.010309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.020683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70924075-af36-43f6-9bfb-0f8891976ee8 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.025861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.026590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.029527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.029878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.030609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.032531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.066277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1102/2235] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:01:55 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:01:55.070244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.081335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c68e0e-dbbb-4edf-82ad-1741f2a8d02e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.144530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.145203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.145563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.145798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.146731 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.148791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.168736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1134/2236] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:01:55 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:01:55.172645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.183348 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72ef7a-37e4-476b-90c9-284ac395a5c5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.188097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.188769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.189053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.189326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.190077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.191673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.202578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1103/2237] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:01:55.206594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.216803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f8c16-979f-4b5f-8da0-44079128175d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.221645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.222655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.223123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.223468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] PATH_INFO: `/v3/projects/142581fe765c41d0a10bdc8f654e4ee1/users/cb2d00ec831a490fbab90de835972a51/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.241237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=142581fe765c41d0a10bdc8f654e4ee1, user_id=cb2d00ec831a490fbab90de835972a51, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.244000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.262117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1135/2238] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:01:55 2022] PUT /identity/v3/projects/142581fe765c41d0a10bdc8f654e4ee1/users/cb2d00ec831a490fbab90de835972a51/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:01:55.266037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.280189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d3c66-0922-45d7-bd95-8860315a5781 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.346583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.347396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.347751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.348103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.349000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.350795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a181-3780-4d8e-9536-1eeb726039d0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.365352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1104/2239] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:01:55.369105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:01:55.382670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527687c-d4fc-4d62-903e-02b30103a5fb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:01:55.388510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:01:55.389414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:55.389819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:55.390051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] PATH_INFO: `/v3/projects/142581fe765c41d0a10bdc8f654e4ee1/users/cb2d00ec831a490fbab90de835972a51/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:55.392533 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=142581fe765c41d0a10bdc8f654e4ee1, user_id=cb2d00ec831a490fbab90de835972a51, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:01:55.399992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e8d3a-0f67-4e44-b2f0-49374d8c36cb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:01:55.424790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1136/2240] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:01:55 2022] PUT /identity/v3/projects/142581fe765c41d0a10bdc8f654e4ee1/users/cb2d00ec831a490fbab90de835972a51/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:01:57.567167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:01:57.568146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:01:57.568634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:01:57.597076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] MFA Rules not processed for user `4892d58f399a44b485514cb29f2259b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:01:57.598620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:01:57.691292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1105/2241] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:02:01.207951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0188c-7a44-44c0-8db0-dccf5c5cfae5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:01.221968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0188c-7a44-44c0-8db0-dccf5c5cfae5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:01.225599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0188c-7a44-44c0-8db0-dccf5c5cfae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:01.329752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-43a0188c-7a44-44c0-8db0-dccf5c5cfae5 None None] MFA Rules not processed for user `cb2d00ec831a490fbab90de835972a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:02:01.348204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-43a0188c-7a44-44c0-8db0-dccf5c5cfae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:01.572063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1137/2242] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:02:01.723828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:01.725463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:01.867016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dac4f-0a5c-48bc-8be4-167500186aaf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:01.875461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:01.877270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:01.878526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:01.878995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:01.961789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:01.965723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ffc2-3f26-4302-aa70-4f7e613b59ba service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:01.988473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1106/2243] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:02:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:02:03.303313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:03.303830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:03.303924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:03.323173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] MFA Rules not processed for user `70d3a9e2d0a14433a9a8627d15b07ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:02:03.324641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:03.335944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1138/2244] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:02:32.362829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:32.363337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:32.363522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:32.382084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:02:32.383268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:32.451312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1107/2245] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:02:32.478174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:32.479692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:32.550407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503e89-390b-474b-8320-df8bf9d338b8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:32.555465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:32.556107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:32.556419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:32.556700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:32.565162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:32.566810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:32.574832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1139/2246] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:02:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:02:41.293916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:41.295892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:41.365091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19189d1-a8c9-4e1d-8c31-4a5252dbb62e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:41.369751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136826-b408-40da-a257-446031034641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:41.370621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136826-b408-40da-a257-446031034641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:41.370906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136826-b408-40da-a257-446031034641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:41.371189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136826-b408-40da-a257-446031034641 admin admin] PATH_INFO: `/v3/users/9f19dad38bba4adb9267a1fcbc26d7b2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:41.372414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136826-b408-40da-a257-446031034641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f19dad38bba4adb9267a1fcbc26d7b2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:41.374402 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136826-b408-40da-a257-446031034641 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:41.422391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba136826-b408-40da-a257-446031034641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f19dad38bba4adb9267a1fcbc26d7b2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.433576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba136826-b408-40da-a257-446031034641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f19dad38bba4adb9267a1fcbc26d7b2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.440418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba136826-b408-40da-a257-446031034641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f19dad38bba4adb9267a1fcbc26d7b2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.441092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba136826-b408-40da-a257-446031034641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f19dad38bba4adb9267a1fcbc26d7b2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.441736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba136826-b408-40da-a257-446031034641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f19dad38bba4adb9267a1fcbc26d7b2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.454848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1108/2247] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:02:41 2022] DELETE /identity/v3/users/9f19dad38bba4adb9267a1fcbc26d7b2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:02:41.623857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:41.636594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0f5d6-6000-4911-a267-91f490850eda service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:41.692933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:41.693822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:41.694113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:41.694395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] PATH_INFO: `/v3/projects/4285af910bec40c4a5a5691d5492f941` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:41.695608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4285af910bec40c4a5a5691d5492f941)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:41.697552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:41.743054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4285af910bec40c4a5a5691d5492f941', 'request_id': 'req-a1ca3979-7f1f-4e60-8a29-9fd29273443f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.749204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4285af910bec40c4a5a5691d5492f941', 'request_id': 'req-a1ca3979-7f1f-4e60-8a29-9fd29273443f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.756237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4285af910bec40c4a5a5691d5492f941', 'request_id': 'req-a1ca3979-7f1f-4e60-8a29-9fd29273443f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.768087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] The token cache is being invalidate because project 4285af910bec40c4a5a5691d5492f941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:02:41.768377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.769003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.770647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1140/2248] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:02:41 2022] DELETE /identity/v3/projects/4285af910bec40c4a5a5691d5492f941 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:02:41.774693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136826-b408-40da-a257-446031034641 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:41.776127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ba136826-b408-40da-a257-446031034641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:41.789057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136826-b408-40da-a257-446031034641 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:41.844459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:41.845355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:41.845673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:41.845959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] PATH_INFO: `/v3/users/f7cbff27a4744479a48fe12845d358d3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:41.847132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cbff27a4744479a48fe12845d358d3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:41.849059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:41.894719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cbff27a4744479a48fe12845d358d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.907866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cbff27a4744479a48fe12845d358d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.914497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cbff27a4744479a48fe12845d358d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.915244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cbff27a4744479a48fe12845d358d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.915863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-392730d9-853a-4939-ac24-e30bd57db4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cbff27a4744479a48fe12845d358d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:41.929018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1109/2249] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:02:41 2022] DELETE /identity/v3/users/f7cbff27a4744479a48fe12845d358d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:02:42.096114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:42.097568 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:42.113134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca3979-7f1f-4e60-8a29-9fd29273443f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:42.172553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:42.173426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:42.173744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:42.174021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] PATH_INFO: `/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:42.175232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891ef7b8d8d54a29870bcaf3d128e07c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:42.177160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:42.227419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891ef7b8d8d54a29870bcaf3d128e07c', 'request_id': 'req-beb46835-5039-4dab-9d95-5279d2fadc73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:42.232867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891ef7b8d8d54a29870bcaf3d128e07c', 'request_id': 'req-beb46835-5039-4dab-9d95-5279d2fadc73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:42.241939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891ef7b8d8d54a29870bcaf3d128e07c', 'request_id': 'req-beb46835-5039-4dab-9d95-5279d2fadc73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:42.253105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] The token cache is being invalidate because project 891ef7b8d8d54a29870bcaf3d128e07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:02:42.253394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:42.254050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:02:42.255570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1141/2250] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:02:42 2022] DELETE /identity/v3/projects/891ef7b8d8d54a29870bcaf3d128e07c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:02:44.551282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:44.551773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:44.551889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:44.569297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] MFA Rules not processed for user `28c76d12b0b1436d8eb0b23acf252f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:02:44.570522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:44.623486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1110/2251] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:02:47.195101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:47.196500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:47.252971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb46835-5039-4dab-9d95-5279d2fadc73 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:47.256676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:47.257332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:47.257652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:47.257937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:47.259737 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:47.329206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:47.330589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:47.341907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1142/2252] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:02:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:02:49.413730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:49.415124 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:49.427400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e008-e7fc-4ff4-a3c2-7b02759d1d29 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:49.431040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:49.431672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:49.431960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:49.432240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:49.434039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:49.447420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:49.448843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:49.459433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1111/2253] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:02:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:02:57.008976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:57.018313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504890-3822-4d06-aaba-e1cdd4615ed8 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:57.021937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:57.022569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:57.022849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:57.023125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:57.024904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:57.088210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:57.089683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43567-8c8a-4f63-9bf0-aa04aed54aa1 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:57.099525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1143/2254] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:02:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:02:57.445813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:02:57.447342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:57.461644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc564-35f1-43c4-815d-540e8952e183 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:02:57.467192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:02:57.467859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:02:57.468134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:02:57.468439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:02:57.470187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:02:57.534857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:02:57.537076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:02:57.547777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1112/2255] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:02:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:00.421222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:00.421718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:00.421830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:00.438874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] MFA Rules not processed for user `8396cfed6d904f859ade91e210c619b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:03:00.439939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:00.446990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1144/2256] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:03:01.054130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:01.055531 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:01.123380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119fed-534a-4a6b-bab7-042362cb8e91 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:01.128248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:01.128886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:01.129170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:01.129450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:01.131208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:01.142291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:01.143861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:01.153841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1113/2257] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:03.218600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:03.220056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:03.246027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:03.256667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d576-b240-43b8-84b1-484835910037 service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:03.261789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:03.262511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:03.262802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:03.263084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:03.267344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:03.287349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:03.288939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:03.299849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1114/2258] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:03:03.346438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4865-102b-4056-b7a0-dff5e0ec09ce None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:03.353130 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:03.354095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:03.354563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:03.356725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] PATH_INFO: `/v3/users/c054038efc2741ba951666abb68e1cf7` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:03.358810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c054038efc2741ba951666abb68e1cf7)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:03.361954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:03.430410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c054038efc2741ba951666abb68e1cf7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.443519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c054038efc2741ba951666abb68e1cf7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.444260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c054038efc2741ba951666abb68e1cf7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.444866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c054038efc2741ba951666abb68e1cf7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.453345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c054038efc2741ba951666abb68e1cf7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.468989 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1145/2259] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:03:03 2022] DELETE /identity/v3/users/c054038efc2741ba951666abb68e1cf7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:03:03.678704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:03.703254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25513-2448-4a29-b1ad-ddad72f43cd9 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:03.762048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:03.762928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:03.763217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:03.763499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] PATH_INFO: `/v3/projects/3a889575293f48af826e9734868e2714` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:03.764823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a889575293f48af826e9734868e2714)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:03.767084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:03.815374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a889575293f48af826e9734868e2714', 'request_id': 'req-d59da2ed-d122-4eba-aa66-fd87a401a6ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.820951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a889575293f48af826e9734868e2714', 'request_id': 'req-d59da2ed-d122-4eba-aa66-fd87a401a6ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.827403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a889575293f48af826e9734868e2714', 'request_id': 'req-d59da2ed-d122-4eba-aa66-fd87a401a6ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.842393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] The token cache is being invalidate because project 3a889575293f48af826e9734868e2714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:03:03.842723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.843435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d59da2ed-d122-4eba-aa66-fd87a401a6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:03:03.845089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1115/2260] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:03:03 2022] DELETE /identity/v3/projects/3a889575293f48af826e9734868e2714 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:03:13.499018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:13.500465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:13.571926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2863e-702b-46a3-a7ad-7fd869421aae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:13.633232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:13.633915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:13.634196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:13.634525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:13.636355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:13.692873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:13.694509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:13.703542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1146/2261] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:19.692677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:19.693174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:19.693278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:19.711758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] MFA Rules not processed for user `bbc14e1f89334e65b24fec7b4a321c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:03:19.712960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:19.764767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1116/2262] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:03:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:03:20.070317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:20.071802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:20.125886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fceb6-5170-47d8-8409-ba224c29db3d service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:20.129495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:20.130140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:20.130426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:20.130706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:20.132444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:20.142214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:20.143634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:20.151182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1147/2263] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:21.029281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:21.030824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:21.089705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b6ef-9175-4ca0-b339-5105b5885966 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:21.094352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:21.095026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:21.095313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:21.095708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:21.097675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:21.162536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:21.163978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:21.173991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1117/2264] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:25.630224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:25.632437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:25.652011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754ee2-7eeb-4e47-9f94-6caedcc9ba7c service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:25.662137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:25.662992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:25.663504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:25.663874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:25.665994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:25.685858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:25.687604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb82ab3-fe55-435a-9432-d6577f13c56d service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:25.721014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1148/2265] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:26.413247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:26.430024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82b03-2f28-4f7f-8ce9-29145261f2fd service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:26.438391 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:26.439446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:26.439884 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:26.440336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:26.443011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:26.460875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:26.462808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:26.481122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1118/2266] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:29.520348 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a19e9-fabe-4b06-8535-b9577c31a42d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:29.520907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a19e9-fabe-4b06-8535-b9577c31a42d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:29.520907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a19e9-fabe-4b06-8535-b9577c31a42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:29.538253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b80a19e9-fabe-4b06-8535-b9577c31a42d None None] MFA Rules not processed for user `aa2d83bcc02a43f89ba4785a9bdedd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:03:29.539473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b80a19e9-fabe-4b06-8535-b9577c31a42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:29.546421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1149/2267] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:03:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:03:33.312750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:33.314792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:33.326719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a656-b789-4f9f-971d-32a23c6a41a5 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:33.330985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:33.331668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:33.331956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:33.332236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:33.334189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:33.408703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:33.410832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:33.423844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1119/2268] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:35.482615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:35.483315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:35.483315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:35.500787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] MFA Rules not processed for user `4892d58f399a44b485514cb29f2259b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:03:35.502015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:35.508781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1150/2269] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:03:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:03:38.343138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:38.345195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:38.361844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97c63-7835-4159-ab73-6d388f96e78a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:38.367544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:38.368183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:38.368466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:38.368740 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:38.370523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:38.383292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:38.384864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:38.396824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1120/2270] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:03:57.606874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:03:57.608279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:57.619940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f6213-3dbf-4b80-ac3b-e8834ec645e8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:03:57.623558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:03:57.624207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:03:57.624492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:03:57.624771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:03:57.626628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:03:57.698481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:03:57.700346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:03:57.714803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1151/2271] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:01.141881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.144233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:01.158620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f92b7-40d5-4204-ba6d-1605df1e7986 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.163203 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.164067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.164349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.164623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] PATH_INFO: `/v3/users/28c76d12b0b1436d8eb0b23acf252f25` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.165837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c76d12b0b1436d8eb0b23acf252f25)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.167744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.214450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c76d12b0b1436d8eb0b23acf252f25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.226426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c76d12b0b1436d8eb0b23acf252f25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.233837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c76d12b0b1436d8eb0b23acf252f25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.234515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c76d12b0b1436d8eb0b23acf252f25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.235115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4be3da66-034c-45b7-9b24-216e34062d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c76d12b0b1436d8eb0b23acf252f25'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.247001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1121/2272] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:01 2022] DELETE /identity/v3/users/28c76d12b0b1436d8eb0b23acf252f25 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:01.420317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.431438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe209bf-04e1-43f8-b074-2e97bde3c744 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.490765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.491618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.491899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.492174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] PATH_INFO: `/v3/projects/8d84ee8b78144447bef24d677ad32b3c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.493397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d84ee8b78144447bef24d677ad32b3c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.495326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.539681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d84ee8b78144447bef24d677ad32b3c', 'request_id': 'req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.544994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d84ee8b78144447bef24d677ad32b3c', 'request_id': 'req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.552253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d84ee8b78144447bef24d677ad32b3c', 'request_id': 'req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.563387 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] The token cache is being invalidate because project 8d84ee8b78144447bef24d677ad32b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:01.563679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.564318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a3ce948-37cc-4a14-b361-ef4b6cf741b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:01.565884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1152/2273] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:01 2022] DELETE /identity/v3/projects/8d84ee8b78144447bef24d677ad32b3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:01.570978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.571272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.571555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.590024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:01.591257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:01.649802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1122/2274] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:01.657498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.657798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.658084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.675905 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:01.677113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:01.684879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1153/2275] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:01.689634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.699747 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539834-ae7e-4bd0-8bd3-5546815bef82 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.705344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.706060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.706346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.706621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.707341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:04:01.707649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.709277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.721378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1123/2276] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:04:01.725673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.734923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad41b7-e4ed-4fe3-9108-2e45183604d7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.741258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.742162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.742700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.743144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.744007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.746479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.783546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1154/2277] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:01 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:01.787677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.798007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d6fe2-a12e-439a-a9a7-9642948c6052 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.852537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.852673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.852906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.853190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.853941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.855857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.877305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1124/2278] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:01 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:01.881463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.892502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6629fc-4811-4f28-98cb-7654e2e77d00 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.897608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.898309 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.898592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.898898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.899633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.901230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.914675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1155/2279] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:01.915933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.925865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf8f8-2f48-415d-8d2c-0ad60fec5f9b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.930693 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.931360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.931648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.931929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.932657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.934296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911ec44-9ec5-4eb2-a2af-bda7bc03705a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.945006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1125/2280] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:01.949293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:01.959754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d66417-899d-4417-8518-2908febc03d8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:01.964619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:01.965536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:01.965819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:01.966098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] PATH_INFO: `/v3/projects/cbd64f1a27a649ed8b6bb1fe32e1cff8/users/29212c53b0814404afc4fbdd41e7bbaf/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:01.980487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd64f1a27a649ed8b6bb1fe32e1cff8, user_id=29212c53b0814404afc4fbdd41e7bbaf, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:01.983750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:01.996769 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1156/2281] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:01 2022] PUT /identity/v3/projects/cbd64f1a27a649ed8b6bb1fe32e1cff8/users/29212c53b0814404afc4fbdd41e7bbaf/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:02.007231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:02.007528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:02.007816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:02.034671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] MFA Rules not processed for user `29212c53b0814404afc4fbdd41e7bbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:02.035877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:02.098101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1126/2282] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:02.108981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:02.110784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:02.181515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da1ac-5dbd-4828-875b-4802efc9e6de admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:02.187035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:02.187707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:02.187986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:02.188259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:02.198675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:02.200258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9a00-a2a8-4737-9b40-8958b79b94c6 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:02.209484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1157/2283] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:04.873999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:04.938459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf33df9-14d6-4e5a-80ca-dc94ab4dd2c3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:04.943345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:04.944265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:04.944553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:04.944835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] PATH_INFO: `/v3/users/29212c53b0814404afc4fbdd41e7bbaf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:04.946098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=29212c53b0814404afc4fbdd41e7bbaf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:04.948049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.006076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29212c53b0814404afc4fbdd41e7bbaf'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.019586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29212c53b0814404afc4fbdd41e7bbaf'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.028362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29212c53b0814404afc4fbdd41e7bbaf'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.030717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29212c53b0814404afc4fbdd41e7bbaf'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.032067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29212c53b0814404afc4fbdd41e7bbaf'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.046820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1127/2284] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:04 2022] DELETE /identity/v3/users/29212c53b0814404afc4fbdd41e7bbaf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:05.051296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.051828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.051945 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.071182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:05.072768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:05.135156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1158/2285] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:05.145703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.147175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:05.207556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259b7f-2abd-4bb6-8038-f9e8f6dd8fdc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.211271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.211918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.212204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.212498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.223110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.224549 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a30f4-bfd8-460f-bbad-213dd2c06c61 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.234574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1128/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:05.548541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.550091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:05.562794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1101e-4187-4c35-b581-987dd15f48a7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.568152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.569014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.569412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.569660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] PATH_INFO: `/v3/projects/cbd64f1a27a649ed8b6bb1fe32e1cff8` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.570839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd64f1a27a649ed8b6bb1fe32e1cff8)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.574116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.623943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd64f1a27a649ed8b6bb1fe32e1cff8', 'request_id': 'req-04383698-5413-430f-b679-166ffbf5a8c7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.629036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd64f1a27a649ed8b6bb1fe32e1cff8', 'request_id': 'req-04383698-5413-430f-b679-166ffbf5a8c7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.636332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd64f1a27a649ed8b6bb1fe32e1cff8', 'request_id': 'req-04383698-5413-430f-b679-166ffbf5a8c7'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.648599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] The token cache is being invalidate because project cbd64f1a27a649ed8b6bb1fe32e1cff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:05.648884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.649529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-04383698-5413-430f-b679-166ffbf5a8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:05.651049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1159/2287] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:05 2022] DELETE /identity/v3/projects/cbd64f1a27a649ed8b6bb1fe32e1cff8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:05.656646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.656933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.657211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.675370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:05.676557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:05.737038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1129/2288] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:05.746110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.746400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.746680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.766495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:05.767691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:05.775584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1160/2289] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:05.780376 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.790289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b914b4c-420f-4eee-bd67-fe3209b6490d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.794952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.795604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.795893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.796174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.796901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:04:05.797213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.798849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.810225 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1130/2290] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:04:05.814563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.823713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce57a6f-3072-449d-aa70-fdb6f2f8ad7b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.829217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.829912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.830201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.830489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.831183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.833106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.859126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1161/2291] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:05 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:05.863201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.873114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7cc-3247-4220-9b46-495a7167a02f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.927932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.928618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.928873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.929154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.929947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.931856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.952816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1131/2292] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:05 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:05.957011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:05.968103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc0fe-a128-4c37-9c37-3829f99aee7b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:05.972736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:05.973389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:05.973705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:05.973987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:05.974713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:05.976344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:05.986824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1162/2293] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:05.990631 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.000691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7d1c-e728-428a-8dcc-3c1533e05baf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.005292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.005988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.006276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.006552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.007275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.008855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee56e4-e9a7-45ba-97b6-566a720b495b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.019490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1132/2294] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:06.023550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.033916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe9ad-a0ac-4cac-880f-566b058ff470 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.038577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.039442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.039728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.040004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] PATH_INFO: `/v3/projects/a21e32219d4940789a593a4ec3c1054c/users/9ccac60413aa4d83af2765f9db4b4081/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.054077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e32219d4940789a593a4ec3c1054c, user_id=9ccac60413aa4d83af2765f9db4b4081, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.056749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.069256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1163/2295] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:06 2022] PUT /identity/v3/projects/a21e32219d4940789a593a4ec3c1054c/users/9ccac60413aa4d83af2765f9db4b4081/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:06.080019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.080318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.080600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.107213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] MFA Rules not processed for user `9ccac60413aa4d83af2765f9db4b4081`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:06.108404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:06.170216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1133/2296] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:06.174566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.235498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d1a7-538c-4403-99b1-6a6398724ba3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.240209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.240864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.241146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.241423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.242153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.244059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.268660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1164/2297] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:06 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:06.272810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.283217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87db85-3c88-4dc2-9542-d6b2b26770a1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.337776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.338443 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.338729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.339011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.339706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.341685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.361372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1134/2298] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:06 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:06.365322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.375898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f108b-003c-426d-b9f2-5d938755f65d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.380463 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.381112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.381398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.381711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.382438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.384033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.395275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1165/2299] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:06.399338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.409260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf660-5c9d-4270-8d1b-7c5683da743c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.413957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.414833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.415116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.415399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] PATH_INFO: `/v3/projects/e8575983ff5e49c19408f3a835a8a7da/users/0fb047bd649a47e2ab5b55a087c37586/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.429726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8575983ff5e49c19408f3a835a8a7da, user_id=0fb047bd649a47e2ab5b55a087c37586, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.432404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.445232 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1135/2300] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:06 2022] PUT /identity/v3/projects/e8575983ff5e49c19408f3a835a8a7da/users/0fb047bd649a47e2ab5b55a087c37586/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:06.449028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.459238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647418d-213d-4b87-9ddb-33d8a7a7e464 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.512791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.513725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.514011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.514286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.515012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.516922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cfc07-b7b2-4953-a2a8-2f1a9ee2c494 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.526377 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1166/2301] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:06.530446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.540382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a9f0-0d46-45d8-b489-adf7ac026f2a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.545877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.546592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.546877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.547156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] PATH_INFO: `/v3/projects/e8575983ff5e49c19408f3a835a8a7da/users/0fb047bd649a47e2ab5b55a087c37586/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.549149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8575983ff5e49c19408f3a835a8a7da, user_id=0fb047bd649a47e2ab5b55a087c37586, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.551881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.563103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1136/2302] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:06 2022] PUT /identity/v3/projects/e8575983ff5e49c19408f3a835a8a7da/users/0fb047bd649a47e2ab5b55a087c37586/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:06.573131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.573517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.573867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.599984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] MFA Rules not processed for user `0fb047bd649a47e2ab5b55a087c37586`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:06.601270 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:06.672395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1167/2303] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:04:06.683340 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:06.685201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:06.741377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dcf73-02e9-4ba2-bfdc-ad084fe88807 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:06.745228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:06.746008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:06.746293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:06.746572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:06.756019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:06.757457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb614515-42ab-4c74-bd8a-7a1ed03b1cae service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:06.767651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1137/2304] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:08.041686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:08.100787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a455-a79f-4a04-9d6f-a39f0ef224ce None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:08.105427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:08.106367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:08.106675 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:08.107009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] PATH_INFO: `/v3/users/9ccac60413aa4d83af2765f9db4b4081` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:08.108189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccac60413aa4d83af2765f9db4b4081)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:08.110159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:08.152995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccac60413aa4d83af2765f9db4b4081'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.164963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccac60413aa4d83af2765f9db4b4081'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.165658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccac60413aa4d83af2765f9db4b4081'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.166262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccac60413aa4d83af2765f9db4b4081'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.176242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccac60413aa4d83af2765f9db4b4081'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.189257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1168/2305] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:08 2022] DELETE /identity/v3/users/9ccac60413aa4d83af2765f9db4b4081 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:08.194196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5534-b070-4540-938e-6be248533023 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:08.194676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5534-b070-4540-938e-6be248533023 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:08.194824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5534-b070-4540-938e-6be248533023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:08.214082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-810c5534-b070-4540-938e-6be248533023 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:08.215260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-810c5534-b070-4540-938e-6be248533023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:08.273119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1138/2306] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:04:08.283303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:08.284725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:08.340631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d40309-5d5c-45d0-a57f-f01375bfb749 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:08.345033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:08.345695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:08.345981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:08.346261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:08.355134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:08.357202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:08.366615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1169/2307] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:08.632198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c5534-b070-4540-938e-6be248533023 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:08.633649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-810c5534-b070-4540-938e-6be248533023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:08.655032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c5534-b070-4540-938e-6be248533023 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:08.659696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:08.660608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:08.660897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:08.661174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] PATH_INFO: `/v3/projects/a21e32219d4940789a593a4ec3c1054c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:08.662389 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21e32219d4940789a593a4ec3c1054c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:08.664295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:08.709866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21e32219d4940789a593a4ec3c1054c', 'request_id': 'req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.715142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21e32219d4940789a593a4ec3c1054c', 'request_id': 'req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.721687 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21e32219d4940789a593a4ec3c1054c', 'request_id': 'req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.733583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] The token cache is being invalidate because project a21e32219d4940789a593a4ec3c1054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:08.733869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.734480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.735980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1139/2308] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:08 2022] DELETE /identity/v3/projects/a21e32219d4940789a593a4ec3c1054c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:08.740021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:08.749750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21057-a096-4a05-a19e-f23117fd30c7 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:08.804950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:08.805874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:08.806146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:08.806414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] PATH_INFO: `/v3/users/0fb047bd649a47e2ab5b55a087c37586` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:08.807592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb047bd649a47e2ab5b55a087c37586)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:08.809727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:08.853371 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb047bd649a47e2ab5b55a087c37586'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.864536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb047bd649a47e2ab5b55a087c37586'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.865180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb047bd649a47e2ab5b55a087c37586'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.865775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb047bd649a47e2ab5b55a087c37586'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.872610 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1728c1a8-c9eb-49e4-89c9-a9c7275a64f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb047bd649a47e2ab5b55a087c37586'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:08.884232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1170/2309] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:08 2022] DELETE /identity/v3/users/0fb047bd649a47e2ab5b55a087c37586 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:09.220966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.222387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:09.238503 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0b267-a3bf-46c5-a6dc-05b52c50e820 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.293338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.294965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.295382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.295662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] PATH_INFO: `/v3/projects/e8575983ff5e49c19408f3a835a8a7da` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.296828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8575983ff5e49c19408f3a835a8a7da)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.298748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.344037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8575983ff5e49c19408f3a835a8a7da', 'request_id': 'req-a003886c-181e-473d-9ca8-8947bf103d20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:09.349259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8575983ff5e49c19408f3a835a8a7da', 'request_id': 'req-a003886c-181e-473d-9ca8-8947bf103d20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:09.355546 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8575983ff5e49c19408f3a835a8a7da', 'request_id': 'req-a003886c-181e-473d-9ca8-8947bf103d20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:09.367830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] The token cache is being invalidate because project e8575983ff5e49c19408f3a835a8a7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:09.368119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:09.368741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a003886c-181e-473d-9ca8-8947bf103d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:09.370335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1140/2310] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:09 2022] DELETE /identity/v3/projects/e8575983ff5e49c19408f3a835a8a7da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:09.375351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.375824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.375922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.393236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:09.394514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:09.452158 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1171/2311] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:09.460856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.461149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.461429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.480316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:09.481601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:09.489931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1141/2312] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:09.494244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.503976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449072a-eaba-4f6a-9fbd-def44f1c9c78 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.508546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.509191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.509498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.509781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.510501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:04:09.510805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.512433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.524599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1172/2313] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:04:09.529968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.538941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be202-5d65-4f92-ae88-32997a2eb959 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.543509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.544165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.544460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.544800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.545498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.547388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.571835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1142/2314] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:09.576461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.586554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6401a-1808-4931-afb2-e4772ba2b222 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.641008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.641552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.641992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.642265 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.643077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.645350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.664779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1173/2315] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:09.674216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.684281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb42a3-253f-4e91-8390-23d7c70f9d5b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.689042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.689743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.690053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.690330 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.691104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.692692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.704175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1143/2316] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:09.708224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.718748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c99ff-4029-4a0b-853b-af76c41feb73 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.723335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.723982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.724269 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.724549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.725266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.726899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8423a-52a0-4579-afb1-ad38e42e460c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.737391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1174/2317] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:09.741653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.751440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813290d-844d-4e5a-a192-d083c1c973b8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.756307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.757190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.757497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.757783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] PATH_INFO: `/v3/projects/ad74e6a7cdb1409189e74e435685795d/users/a3cb704151704c41aa9f2a0bce7472eb/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.774058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad74e6a7cdb1409189e74e435685795d, user_id=a3cb704151704c41aa9f2a0bce7472eb, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.776721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.790373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1144/2318] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:09 2022] PUT /identity/v3/projects/ad74e6a7cdb1409189e74e435685795d/users/a3cb704151704c41aa9f2a0bce7472eb/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:09.800601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.800890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.801172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.827285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] MFA Rules not processed for user `a3cb704151704c41aa9f2a0bce7472eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:09.828464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:09.889194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1175/2319] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:09.893924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:09.952586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768863-a965-4ca6-a202-8048d9189328 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:09.957152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:09.957823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:09.958109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:09.958383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:09.959058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:09.960948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:09.985413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1145/2320] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:09.989409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.001122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d7c8-b3e9-4fcb-9311-22a1a1c2d6d0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.054039 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.054697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.054980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.055255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.055931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.057886 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.078067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1176/2321] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:09 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:10.082031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.092308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625aac3-7738-45b9-bf53-660664dc3c3f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.097160 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.097841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.098128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.098407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.099273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.101109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.118127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1146/2322] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:10.119268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.129858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106078b8-f097-43d3-83da-898b607409dc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.134423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.135310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.135577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.135852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] PATH_INFO: `/v3/projects/ec2a78cc197541f281bfa156a2a21c98/users/3bfd984d8ae74481af1fa2fd03a0d491/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.152789 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2a78cc197541f281bfa156a2a21c98, user_id=3bfd984d8ae74481af1fa2fd03a0d491, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.155488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.168503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1177/2323] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:10 2022] PUT /identity/v3/projects/ec2a78cc197541f281bfa156a2a21c98/users/3bfd984d8ae74481af1fa2fd03a0d491/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:10.172552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.182754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb91c-c2e3-4df8-863f-e19e07b104c3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.243516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.244177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.244451 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.244754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.245489 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.247291 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ab4e6-059e-480f-a992-357f710a43e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.257494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1147/2324] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:04:10.261447 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.277140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a562a5-c9fe-46b0-aeaf-ae0b826849ce admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.282564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.283461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.283740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.284014 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] PATH_INFO: `/v3/projects/ec2a78cc197541f281bfa156a2a21c98/users/3bfd984d8ae74481af1fa2fd03a0d491/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.286015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2a78cc197541f281bfa156a2a21c98, user_id=3bfd984d8ae74481af1fa2fd03a0d491, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.288626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.298745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1178/2325] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:10 2022] PUT /identity/v3/projects/ec2a78cc197541f281bfa156a2a21c98/users/3bfd984d8ae74481af1fa2fd03a0d491/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:10.310234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.310566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.310856 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.336895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] MFA Rules not processed for user `3bfd984d8ae74481af1fa2fd03a0d491`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:10.338130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:10.404610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1148/2326] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:10.415051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:10.416755 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:10.471477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed6e48-95b9-460a-9f06-b269c8458218 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:10.475041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:10.475664 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:10.475946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:10.476222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:10.532295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:10.533766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8344-7c7e-4b9d-aae7-d05bf90a9664 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:10.542303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1179/2327] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:15.132215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:15.143079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ca4b6-af46-4472-8a85-03a3a83f6dd9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:15.146764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:15.147407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:15.147695 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:15.147975 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:15.157005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:15.158476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:15.167795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1149/2328] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:30.779448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:30.779978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:30.780082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:30.798140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:30.799339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:30.853979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1180/2329] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:30.903106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:30.904590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:30.976459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437668-1088-48ed-9e4f-5def158b9177 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:30.982000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:30.982675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:30.982965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:30.983244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:30.991250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:30.992849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb725e0e-d3fe-47ed-9634-004ade3ed5f5 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:31.000877 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1150/2330] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:04:40.130777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:40.192182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d57e6-ab5b-49da-b21e-c8fd8fbf969d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:40.196583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:40.197442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:40.197758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:40.198034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] PATH_INFO: `/v3/users/a3cb704151704c41aa9f2a0bce7472eb` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:40.199241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cb704151704c41aa9f2a0bce7472eb)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:40.201149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:40.245870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cb704151704c41aa9f2a0bce7472eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.257077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cb704151704c41aa9f2a0bce7472eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.257760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cb704151704c41aa9f2a0bce7472eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.258365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cb704151704c41aa9f2a0bce7472eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.265957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cb704151704c41aa9f2a0bce7472eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.278074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1181/2331] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:40 2022] DELETE /identity/v3/users/a3cb704151704c41aa9f2a0bce7472eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:40.282538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:40.282991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:40.283085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:40.299706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:40.300924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:40.356801 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1151/2332] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:40.366342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:40.367734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:40.423431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195a5e-c84f-433c-a79f-bd4f494ad50c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:40.427111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:40.427754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:40.428041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:40.428323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:40.437794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:40.439224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:40.448422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1182/2333] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:40.709441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:40.711193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:40.734634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d5b79-3578-45e1-832b-a840b1e2af8f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:40.741125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:40.742481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:40.742949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:40.743532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] PATH_INFO: `/v3/projects/ad74e6a7cdb1409189e74e435685795d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:40.745331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad74e6a7cdb1409189e74e435685795d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:40.747911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:40.800626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad74e6a7cdb1409189e74e435685795d', 'request_id': 'req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.810117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad74e6a7cdb1409189e74e435685795d', 'request_id': 'req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.816711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad74e6a7cdb1409189e74e435685795d', 'request_id': 'req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.833713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] The token cache is being invalidate because project ad74e6a7cdb1409189e74e435685795d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:40.834121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.834875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.837373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1152/2334] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:40 2022] DELETE /identity/v3/projects/ad74e6a7cdb1409189e74e435685795d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:40.841830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:40.852699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86138e7-5645-43af-9e2d-e9438e47cddb service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:40.916113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:40.917137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:40.919126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:40.919455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] PATH_INFO: `/v3/users/3bfd984d8ae74481af1fa2fd03a0d491` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:40.920703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfd984d8ae74481af1fa2fd03a0d491)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:40.922776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:40.975111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfd984d8ae74481af1fa2fd03a0d491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.987339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfd984d8ae74481af1fa2fd03a0d491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.988411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfd984d8ae74481af1fa2fd03a0d491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.989022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfd984d8ae74481af1fa2fd03a0d491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:40.996480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-40cf6d64-3435-454f-9e58-0796492f5626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfd984d8ae74481af1fa2fd03a0d491'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.008591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1183/2335] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:04:40 2022] DELETE /identity/v3/users/3bfd984d8ae74481af1fa2fd03a0d491 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:41.350188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.351665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:41.364774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d066b-7e82-4f30-9e73-ed5b2bc8e1e4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.420540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.421397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.421711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.421996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] PATH_INFO: `/v3/projects/ec2a78cc197541f281bfa156a2a21c98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.423167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2a78cc197541f281bfa156a2a21c98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.425094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.469505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2a78cc197541f281bfa156a2a21c98', 'request_id': 'req-bc17191c-7741-43e9-af2a-6c9aeabec090'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.474717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2a78cc197541f281bfa156a2a21c98', 'request_id': 'req-bc17191c-7741-43e9-af2a-6c9aeabec090'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.480906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2a78cc197541f281bfa156a2a21c98', 'request_id': 'req-bc17191c-7741-43e9-af2a-6c9aeabec090'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.492982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] The token cache is being invalidate because project ec2a78cc197541f281bfa156a2a21c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:04:41.493268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.493932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bc17191c-7741-43e9-af2a-6c9aeabec090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:04:41.495495 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1153/2336] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:04:41 2022] DELETE /identity/v3/projects/ec2a78cc197541f281bfa156a2a21c98 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:04:41.500959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.501452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.501586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.519076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:41.520276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:41.577721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1184/2337] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:41.585598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.585914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.586198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.604797 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:41.606521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:41.614312 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1154/2338] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:41.618362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.628539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe86791-c7ed-40cd-8d38-933256ecfe58 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.633122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.633802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.634093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.634376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.635133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:04:41.635444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.637690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.649558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1185/2339] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:04:41.654460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.663520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da861a-a9f8-47ad-97de-c0408d61b5e7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.669032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.669723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.670008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.670288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.670981 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.672919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.700782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1155/2340] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:04:41 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:41.704795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.716109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d2147-071e-4909-9a25-50fe0fea587a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.782544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.783222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.783509 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.783790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.784666 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.786638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.809440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1186/2341] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:04:41 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:04:41.810640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.820902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2098e-1781-4dbc-9969-02caf33d9f95 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.826248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.826907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.827195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.827475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.828231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.829896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.841513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1156/2342] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:04:41.845567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.856339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542824-f52b-40ee-95e6-795b405486e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.861754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.862414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.862707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.862991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.863742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.865378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189246-19b1-4648-b62c-5054bd96fdd9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.876692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1187/2343] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:04:41.880969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:41.892986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8a83-a67f-4bc6-8737-b18a0f3ac34a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:41.898336 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:41.899677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.900002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.900281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] PATH_INFO: `/v3/projects/63a56e2821514efd9e3eece5040ef1cb/users/c95cd765140f436987770debf75785df/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.915736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a56e2821514efd9e3eece5040ef1cb, user_id=c95cd765140f436987770debf75785df, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:41.918547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:41.941547 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1157/2344] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:04:41 2022] PUT /identity/v3/projects/63a56e2821514efd9e3eece5040ef1cb/users/c95cd765140f436987770debf75785df/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:04:41.952000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:41.952292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:41.952574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:41.986834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] MFA Rules not processed for user `c95cd765140f436987770debf75785df`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:41.987470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:42.067148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1188/2345] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:42.078966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:42.080934 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:42.139069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853208a3-61cd-4b5b-8b85-7e35943058de admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:42.143102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:42.143756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:42.144032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:42.144339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:42.152572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:42.154033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53e691-22fd-4712-942c-ee3d49e7a27e service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:42.162721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1158/2346] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:45.278634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:45.280193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:45.337133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34251-ac57-40be-bdb6-c38213ac26c8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:45.340988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:45.341704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:45.341994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:45.342275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:45.344057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:45.354083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:45.355636 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:45.363516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1189/2347] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:04:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:04:47.466919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:47.467414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:47.467509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:47.486974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:04:47.488239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:47.544429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1159/2348] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:04:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:04:47.556973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:04:47.558393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:04:47.628889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd410-a5ad-4d0f-a2f9-c182f7f6d450 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:04:47.634115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:04:47.634772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:04:47.635056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:04:47.635626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:04:47.645552 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:04:47.647205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b372-df89-4a30-8090-508f71cd6aff service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:04:47.661896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1190/2349] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:04:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:05:01.885259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:01.947779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a50d-bf2f-413a-947b-2dd5d3e18ddf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:01.952970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:01.953898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:01.954188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:01.954469 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] PATH_INFO: `/v3/users/c95cd765140f436987770debf75785df` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:01.955646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95cd765140f436987770debf75785df)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:01.957640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:02.002789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95cd765140f436987770debf75785df'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.014607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95cd765140f436987770debf75785df'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.022081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95cd765140f436987770debf75785df'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.022778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95cd765140f436987770debf75785df'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.023381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95cd765140f436987770debf75785df'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.037509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1160/2350] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:01 2022] DELETE /identity/v3/users/c95cd765140f436987770debf75785df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:02.041855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.042319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.042417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.061883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:02.063260 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:02.128663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1191/2351] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:02.138303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:02.140305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:02.208171 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45318b5-ad19-45e3-9637-2ca570a60d07 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:02.213319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:02.213954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.214405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.214744 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.227703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:02.229418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d790-154c-48c4-9df3-88e93a4797b1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:02.241544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1161/2352] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:02.618061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:02.619519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:02.631872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800d996-d27c-431f-a5ac-f6281cbf24c0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:02.637667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:02.638485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.639181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.639560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] PATH_INFO: `/v3/projects/63a56e2821514efd9e3eece5040ef1cb` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.640941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a56e2821514efd9e3eece5040ef1cb)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:02.642889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:02.692734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a56e2821514efd9e3eece5040ef1cb', 'request_id': 'req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.698446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a56e2821514efd9e3eece5040ef1cb', 'request_id': 'req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.707136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a56e2821514efd9e3eece5040ef1cb', 'request_id': 'req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.720762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] The token cache is being invalidate because project 63a56e2821514efd9e3eece5040ef1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:02.721062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.721753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-45ef6e53-c0e9-4ec3-81af-3f736838a1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:02.723367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1192/2353] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:02 2022] DELETE /identity/v3/projects/63a56e2821514efd9e3eece5040ef1cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:02.728191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.728479 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.728761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.746691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:02.748170 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:02.807266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1162/2354] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:02.815002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.815297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.815583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.834074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:02.835274 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:02.844571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1193/2355] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:02.848948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:02.858659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed553b2-92d4-4775-8484-41c9715c9f3c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:02.863197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:02.863851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.864136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.864414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.865138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:02.865445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:02.867075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:02.879106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1163/2356] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:05:02.883523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:02.893996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02734f-ed40-4c32-9400-ccf5c0516f29 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:02.898550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:02.899190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.899473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.899749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.900467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:02.902388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:02.928480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1194/2357] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:02 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:02.932158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:02.941850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8bbe-10fd-4c8e-8ae6-90105f0ed35c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:02.996211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:02.996867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:02.997152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:02.997428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:02.998251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.000154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.019480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1164/2358] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:02 2022] POST /identity/v3/users => generated 280 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:03.023500 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.034370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfff84-6006-4c7d-a5ff-4622c1e56058 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.038888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.039539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.039824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.040106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.040860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.042495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.052569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1195/2359] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:03.056382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.066890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73766ebb-6158-4dda-b379-25a5afbb307d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.071457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.072106 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.072387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.072664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.073387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.074986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99126e91-81a2-48ae-825d-2b7ea554c4cb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.085457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1165/2360] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:03.089603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.099331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc071-5259-4114-8dd6-be8e611a7034 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.103972 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.104830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.105111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.105448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] PATH_INFO: `/v3/projects/3e1908bdeb6646548b9ee5ee01c5b80a/users/575a28e880ba4befb8767e91cde34f20/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.119539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1908bdeb6646548b9ee5ee01c5b80a, user_id=575a28e880ba4befb8767e91cde34f20, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.122206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.136637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1196/2361] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:03 2022] PUT /identity/v3/projects/3e1908bdeb6646548b9ee5ee01c5b80a/users/575a28e880ba4befb8767e91cde34f20/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:03.147962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.148200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.148485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.174557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] MFA Rules not processed for user `575a28e880ba4befb8767e91cde34f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:03.175774 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:03.239273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1166/2362] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:03.272093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.273884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:03.329408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ff1f-e84b-416d-8d11-42f7d7b46853 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.333032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.333707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.333990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.334297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.342645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.344074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e66aa7-572e-4fda-85a3-c4a825af2ebf service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.352837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1197/2363] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:03 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:03.366592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.428908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eefe1-ae4c-4301-86d6-a0767f5ef232 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.434004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.435032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.435304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.436592 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] PATH_INFO: `/v3/users/575a28e880ba4befb8767e91cde34f20` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.437848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=575a28e880ba4befb8767e91cde34f20)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.439758 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.484987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575a28e880ba4befb8767e91cde34f20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:03.496683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575a28e880ba4befb8767e91cde34f20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:03.504400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575a28e880ba4befb8767e91cde34f20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:03.505128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575a28e880ba4befb8767e91cde34f20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:03.505777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575a28e880ba4befb8767e91cde34f20'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:03.518857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1167/2364] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:03 2022] DELETE /identity/v3/users/575a28e880ba4befb8767e91cde34f20 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:03.523362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.523656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.523942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.540804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:03.542614 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:03.601638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1198/2365] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:03.611179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.612556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:03.668614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32501b16-3fb0-4500-aebe-7b4ade0aeb9d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.672228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.672949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.673229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.673527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.682210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.683659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a7fa-0e67-4f47-b3de-a5c2f64ca0de service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:03.692806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1168/2366] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:03.948793 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:03.950211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:03.963102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2efc-f0be-4c8c-9cb3-7939b78aa0ad None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:03.968256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:03.969123 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:03.969410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:03.969722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] PATH_INFO: `/v3/projects/3e1908bdeb6646548b9ee5ee01c5b80a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:03.970907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1908bdeb6646548b9ee5ee01c5b80a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:03.972893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.019565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1908bdeb6646548b9ee5ee01c5b80a', 'request_id': 'req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:04.025033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1908bdeb6646548b9ee5ee01c5b80a', 'request_id': 'req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:04.032936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1908bdeb6646548b9ee5ee01c5b80a', 'request_id': 'req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:04.044318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] The token cache is being invalidate because project 3e1908bdeb6646548b9ee5ee01c5b80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:04.044971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:04.045365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9602e522-a5db-4bd3-81a6-4cb8d52c4bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:04.046946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1199/2367] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:03 2022] DELETE /identity/v3/projects/3e1908bdeb6646548b9ee5ee01c5b80a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:04.051832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.052283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.052395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.071385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:04.072652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.132399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1169/2368] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:04.141872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.142165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.142449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.161975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:04.163161 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.171690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1200/2369] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:05:04.176302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.186553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f70ae-807d-4ba5-bc44-dac298938531 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.191195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.191932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.192142 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.192422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.193145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:04.193456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.195082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.207731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1170/2370] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:05:04.211950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.221790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0c0c7-d14b-451f-a292-d2f32fb08be2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.226472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.227113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.227398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.227673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.228354 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.230346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.254598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1201/2371] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:04.258994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.269428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d799831-48bf-48db-a761-b45290acf379 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.323581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.324173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.324455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.324732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.325424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.327985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.349845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1171/2372] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:04.354041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.364433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee362-e2c3-4ff6-bfe2-b97b280f18c4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.369092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.369787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.370076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.370358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.371079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.372687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.382700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1202/2373] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:04.386522 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.396996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659737-7128-4eba-8542-c1f2566d2a72 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.401795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.402438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.402722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.402998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.403708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.406099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150ba51-0a7f-419d-9751-da533c29eaa1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.415525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1172/2374] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:05:04.419342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.429070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900e192-afd0-4b5e-ac22-694b6069369e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.433724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.434616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.434900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.435175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] PATH_INFO: `/v3/projects/d6cf188f764d4d89adaefee9c722028d/users/ef66f93c1df5466db3b15713d077254c/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.449628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf188f764d4d89adaefee9c722028d, user_id=ef66f93c1df5466db3b15713d077254c, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.453106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.466871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1203/2375] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:04 2022] PUT /identity/v3/projects/d6cf188f764d4d89adaefee9c722028d/users/ef66f93c1df5466db3b15713d077254c/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:05:04.477716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab7f3-3db2-4b90-9c1f-90acb2c8a2a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.478018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab7f3-3db2-4b90-9c1f-90acb2c8a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.478353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab7f3-3db2-4b90-9c1f-90acb2c8a2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.505588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ed0ab7f3-3db2-4b90-9c1f-90acb2c8a2a1 None None] MFA Rules not processed for user `ef66f93c1df5466db3b15713d077254c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:04.506822 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ed0ab7f3-3db2-4b90-9c1f-90acb2c8a2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.570466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1173/2376] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:04.582350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.584433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.589294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.589773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.590128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.607795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:04.609091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.660726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35d8ce-a58a-4559-a052-0a15d6080e30 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.665728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.666376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.666659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.666934 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.670374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1174/2377] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:05:04.675750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.677258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.684716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:04.687137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:04.689349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1204/2378] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:04.788530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6eaa4-47a5-48e7-9e83-346baba8ad4d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:04.794499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:04.795188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:04.795506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:04.795792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:04.804741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:04.806370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4718f5d-684f-4703-b688-c21a4c09d356 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:04.815218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1175/2379] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:05:23.334969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:23.401576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250d70-4bfa-4df0-b9ea-82724b351233 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:23.406544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:23.407339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:23.407660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:23.407959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] PATH_INFO: `/v3/users/ef66f93c1df5466db3b15713d077254c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:23.409173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef66f93c1df5466db3b15713d077254c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:23.411122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:23.457287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef66f93c1df5466db3b15713d077254c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:23.468710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef66f93c1df5466db3b15713d077254c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:23.469389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef66f93c1df5466db3b15713d077254c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:23.470031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef66f93c1df5466db3b15713d077254c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:23.477071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef66f93c1df5466db3b15713d077254c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:23.490015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1205/2380] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:23 2022] DELETE /identity/v3/users/ef66f93c1df5466db3b15713d077254c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:23.494498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befa7b-4f16-4300-acd5-00420747729a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:23.494993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befa7b-4f16-4300-acd5-00420747729a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:23.495108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befa7b-4f16-4300-acd5-00420747729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:23.512844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-26befa7b-4f16-4300-acd5-00420747729a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:23.514635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26befa7b-4f16-4300-acd5-00420747729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:23.570676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1176/2381] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:23.580923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:23.582432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:23.637567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6002ea-0315-46da-b1c6-2f3487908a18 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:23.642308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:23.642955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:23.643238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:23.643517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:23.652493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:23.653969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cbb43-203f-4fed-b1ac-2b5922ebbac6 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:23.663171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1206/2382] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:23.960868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befa7b-4f16-4300-acd5-00420747729a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:23.962658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26befa7b-4f16-4300-acd5-00420747729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:23.987200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befa7b-4f16-4300-acd5-00420747729a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:23.993002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:23.994122 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:23.994473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:23.994815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] PATH_INFO: `/v3/projects/d6cf188f764d4d89adaefee9c722028d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:23.996079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cf188f764d4d89adaefee9c722028d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:23.998177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.056573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cf188f764d4d89adaefee9c722028d', 'request_id': 'req-f448ee3c-6eab-4d97-ae0d-d3a114531a45'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:24.065320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cf188f764d4d89adaefee9c722028d', 'request_id': 'req-f448ee3c-6eab-4d97-ae0d-d3a114531a45'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:24.072807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cf188f764d4d89adaefee9c722028d', 'request_id': 'req-f448ee3c-6eab-4d97-ae0d-d3a114531a45'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:24.087015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] The token cache is being invalidate because project d6cf188f764d4d89adaefee9c722028d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:24.087608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:24.088239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f448ee3c-6eab-4d97-ae0d-d3a114531a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:24.098670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1177/2383] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:23 2022] DELETE /identity/v3/projects/d6cf188f764d4d89adaefee9c722028d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:24.103743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.104066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.104356 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.125022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:24.126262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:24.186485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1207/2384] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:24.193973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.194266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.194574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.212300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:24.213493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:24.221876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1178/2385] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:24.226011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.236766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954867-9839-4438-9c91-02555ecb71d5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.241497 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.242172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.242486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.242760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.243483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:24.243790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.245423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.256888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1208/2386] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:05:24.261133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.270630 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ce612-10cf-42c0-907b-fa3788b4c1a0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.275364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.276012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.276297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.276577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.277269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.279220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.305567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1179/2387] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:24 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:24.309715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.320095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585ea31-b5bb-4218-93c2-3b41373b6094 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.376573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.377234 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.377538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.377841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.378583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.380730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.400417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1209/2388] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:24 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:24.405050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.415092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56741266-1cfa-4120-a94c-feec2c529bce admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.419658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.420957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.421246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.421552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.422310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.423908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.434059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1180/2389] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:24.437957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.447808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac23f-9176-4c05-9647-18dbe371be79 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.453351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.454041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.454329 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.454609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.455368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.457040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1bfa-864a-4882-8faf-f74d9f422bf0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.466959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1210/2390] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:24.471561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.481781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c2edf-dd49-473b-9bf8-9684464f90de admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.486558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.487573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.487860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.488287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] PATH_INFO: `/v3/projects/a40603d2f46d4ad2986e9277a47a8211/users/34e24c80364642b083dc32697f7320ad/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.504050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40603d2f46d4ad2986e9277a47a8211, user_id=34e24c80364642b083dc32697f7320ad, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.507085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.520846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1181/2391] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:24 2022] PUT /identity/v3/projects/a40603d2f46d4ad2986e9277a47a8211/users/34e24c80364642b083dc32697f7320ad/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:05:24.526092 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ca75-fd4a-4828-aa19-3259ab761f19 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.526403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ca75-fd4a-4828-aa19-3259ab761f19 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.526667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ca75-fd4a-4828-aa19-3259ab761f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.544734 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-97e9ca75-fd4a-4828-aa19-3259ab761f19 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:24.545995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-97e9ca75-fd4a-4828-aa19-3259ab761f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:24.603253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1211/2392] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:24.613174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:24.614922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:24.671033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f921a9-e7fd-4b7d-95f1-545fcf8b4aa3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:24.674699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:24.675364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:24.675648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:24.675926 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:24.685098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:24.686694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:24.697290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1182/2393] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:25.689185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:25.689727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:25.689817 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:25.721396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] MFA Rules not processed for user `34e24c80364642b083dc32697f7320ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:25.722864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:25.788951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:25.790662 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:25.798606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1212/2394] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:25.806109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:25.807612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:25.848959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6cac-1312-4d34-9581-54947400ab9f service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:25.852677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:25.853366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:25.853715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:25.853997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:25.855930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:25.870548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aebf9-92a1-4d89-ab9c-e74411d3acf0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:25.875345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:25.876007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:25.876291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:25.876601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:25.885730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:25.887177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fce3e-197e-4295-9c2c-6f3640f2552f service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:25.897226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1213/2395] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:05:25.923576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:25.925027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa941b8-c8e6-4bfb-991f-6606c9eee66a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:25.933872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1183/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:05:26.501336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.501661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.501966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.503365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1214/2397] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 06:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:05:26.510874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38a39-0d07-4f58-ad03-bbad846533d0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.511299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38a39-0d07-4f58-ad03-bbad846533d0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.511685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38a39-0d07-4f58-ad03-bbad846533d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.537905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-19b38a39-0d07-4f58-ad03-bbad846533d0 None None] MFA Rules not processed for user `9bc3cba26628440a84f722b77f4e1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:26.539259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-19b38a39-0d07-4f58-ad03-bbad846533d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:26.546807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1184/2398] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:26.565926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:26.567889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:26.582210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64420522-a036-44dc-bd6f-d7244f2a2642 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:26.585967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:26.586750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.587126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.587496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.596044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:26.597799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea81f51-a164-4559-80c1-12a3bc4d0b98 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:26.606319 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1215/2399] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:05:26.763560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35445d6-fdd0-47e0-80ab-e2b4394b22f0 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.764449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35445d6-fdd0-47e0-80ab-e2b4394b22f0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.764808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35445d6-fdd0-47e0-80ab-e2b4394b22f0 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.766917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1185/2400] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 11 06:05:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:05:26.772510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f74ff-7998-4e06-bf66-58d749b16ce6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.773004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f74ff-7998-4e06-bf66-58d749b16ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.773217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f74ff-7998-4e06-bf66-58d749b16ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.792564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-580f74ff-7998-4e06-bf66-58d749b16ce6 None None] MFA Rules not processed for user `103951448cfc47bbb702f2117cc5b362`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:26.793792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-580f74ff-7998-4e06-bf66-58d749b16ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:26.868947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1216/2401] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 11 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:26.879554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35445d6-fdd0-47e0-80ab-e2b4394b22f0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:26.902103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35445d6-fdd0-47e0-80ab-e2b4394b22f0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:26.906520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:26.907326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:26.907683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:26.908321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:26.924609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:26.926110 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a198b-8369-4906-84e8-3de8297b6a13 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:26.937618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1186/2402] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:29.555670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:29.557322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:29.557912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:29.596751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] MFA Rules not processed for user `34e24c80364642b083dc32697f7320ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:29.598806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:29.610251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1217/2403] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:32.823195 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:32.823701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:32.823805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:32.854393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] MFA Rules not processed for user `bbc14e1f89334e65b24fec7b4a321c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:32.855598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:32.863262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1187/2404] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:35.946863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:35.957355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513e09c-e172-4a26-b122-6400290a7ebc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:35.960973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:35.961700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:35.962064 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:35.962366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:35.964145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:35.976323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:35.977874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:35.988686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1218/2405] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:41.453162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:41.468603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d43e4-458b-475d-bdca-abbd7825088d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:41.472771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:41.473457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:41.474261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:41.474556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:41.476356 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:41.490891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:41.492404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:41.503827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1188/2406] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:41.658375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:41.659981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:41.674399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c7de2-a4e3-480d-8cc3-bde8cf64f79e service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:41.687019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:41.687991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:41.688773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:41.689154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] PATH_INFO: `/v3/users/4892d58f399a44b485514cb29f2259b1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:41.690553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4892d58f399a44b485514cb29f2259b1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:41.692643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:41.778322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4892d58f399a44b485514cb29f2259b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:41.796624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4892d58f399a44b485514cb29f2259b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:41.797654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4892d58f399a44b485514cb29f2259b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:41.798489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4892d58f399a44b485514cb29f2259b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:41.809021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb4a0e62-ba5a-426c-9f32-cb1b3a21186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4892d58f399a44b485514cb29f2259b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:41.866275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1219/2407] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:41 2022] DELETE /identity/v3/users/4892d58f399a44b485514cb29f2259b1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:42.407204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.417776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9b234-f030-4b95-8c2a-d6941e785c43 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.487790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.492945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.493362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.493878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] PATH_INFO: `/v3/projects/34db399b717b42f18c5190acb605918f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.495411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34db399b717b42f18c5190acb605918f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.497411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.547897 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34db399b717b42f18c5190acb605918f', 'request_id': 'req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:42.553244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34db399b717b42f18c5190acb605918f', 'request_id': 'req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:42.559345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34db399b717b42f18c5190acb605918f', 'request_id': 'req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:42.574827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] The token cache is being invalidate because project 34db399b717b42f18c5190acb605918f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:42.575212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:42.575928 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1341fb25-05cb-4f6c-ac15-ac4e4edaf73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:42.578091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1189/2408] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:42 2022] DELETE /identity/v3/projects/34db399b717b42f18c5190acb605918f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:42.582719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.583005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.583280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.604601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:42.606055 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:42.672494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1220/2409] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:42.680079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.680369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.680655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.702047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:42.703644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:42.713611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1190/2410] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:42.716456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.726843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1058b59-2356-4aa2-90a9-46c841f700f8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.731808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.732485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.733766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.734053 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.734978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:42.735485 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.737291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.751694 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1221/2411] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:05:42.755984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.772998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb989d-7245-4bb0-b727-3a98e2af90e6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.779218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.780539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.780827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.781103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.781837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.784295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.813598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1191/2412] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:42 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:42.814772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.824627 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134d49-76e3-4086-9160-a99d580f44c2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.880716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.881272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.881585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.881864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.882595 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.884535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.909242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1222/2413] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:42 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:42.910427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.921946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb66573-b0c7-4b98-9ccd-724034849a98 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.926748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.927412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.927698 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.927979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.928699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.930507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.941379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1192/2414] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:42.945378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.957379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6bae4-486f-4239-b54f-7c025edf6f25 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.962599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.963323 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.963691 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.964603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:42.965393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:42.967211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308168c2-3bda-4484-90f0-b97d87ca1874 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:42.977459 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1223/2415] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:42.981446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:42.991949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62daf6b-353f-45ab-85e5-5b0a64bc3732 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:42.996540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:42.997431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:42.997766 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:42.998045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] PATH_INFO: `/v3/projects/1e75b460d7804911a42e68ea34563308/users/b5c2313bc51d4035986a8c4568a5e060/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.012827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e75b460d7804911a42e68ea34563308, user_id=b5c2313bc51d4035986a8c4568a5e060, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.015930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.034394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1193/2416] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:42 2022] PUT /identity/v3/projects/1e75b460d7804911a42e68ea34563308/users/b5c2313bc51d4035986a8c4568a5e060/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:43.044386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.044686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.045592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.072725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] MFA Rules not processed for user `b5c2313bc51d4035986a8c4568a5e060`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:43.073985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:43.168948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1224/2417] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:43.170773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.257672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7098-e817-46de-a765-3bf6ffe9b669 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.264072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.264855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.265175 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.265761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.266683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.268871 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.303633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1194/2418] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:43 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:43.307148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.320461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363d4bd-a5b5-4fa2-9426-6453aae0a976 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.428520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.428520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.431113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.431113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.431113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.434890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.483556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1225/2419] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:43 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:43.484978 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.500103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362ee17-5e1a-40f1-9004-ed4a4ee7c642 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.510545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.511562 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.512117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.512610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.513613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.516268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.536949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1195/2420] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:43.540710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.553290 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d1f-1832-46cd-a97a-e2b5d63993c0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.559201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.560389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.561841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.562233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] PATH_INFO: `/v3/projects/d2197537db5d4b609d7bad01e178b8e5/users/9060dcb5ddbf4d28ae294a3972b3dcef/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.584077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2197537db5d4b609d7bad01e178b8e5, user_id=9060dcb5ddbf4d28ae294a3972b3dcef, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.587152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.603444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1226/2421] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:43 2022] PUT /identity/v3/projects/d2197537db5d4b609d7bad01e178b8e5/users/9060dcb5ddbf4d28ae294a3972b3dcef/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:05:43.607271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.618301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2d469-b454-44cf-a3c4-b4ba8751159f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.683285 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.684094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.684707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.685217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.686930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.688831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b0baa-fcc6-4bd1-b1f8-bf3814032da9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.702426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1196/2422] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:05:43.703703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.716753 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53a80-3aeb-45bd-a8f0-b4458d1234ae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:43.722768 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:43.723870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.724254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.724715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] PATH_INFO: `/v3/projects/d2197537db5d4b609d7bad01e178b8e5/users/9060dcb5ddbf4d28ae294a3972b3dcef/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.727659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2197537db5d4b609d7bad01e178b8e5, user_id=9060dcb5ddbf4d28ae294a3972b3dcef, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:43.730704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:43.753562 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1227/2423] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:43 2022] PUT /identity/v3/projects/d2197537db5d4b609d7bad01e178b8e5/users/9060dcb5ddbf4d28ae294a3972b3dcef/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:43.756930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:43.757249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:43.757587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:43.790951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] MFA Rules not processed for user `9060dcb5ddbf4d28ae294a3972b3dcef`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:43.792190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:43.920738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1197/2424] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:43.939019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:43.942175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:44.023650 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3ba-67ef-41ab-abbd-cef0086e3b83 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:44.028109 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:44.028766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:44.029049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:44.030000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:44.040395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:44.041915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:44.052674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1228/2425] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:44.143283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:44.153930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cc411-b9ee-42b3-b3d4-cee676654764 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:44.158343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:44.159120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:44.159502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:44.159907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:44.228126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:44.229952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:44.241428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1198/2426] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:45.565171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:45.566680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:45.672843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9294-d15c-478c-87dc-8b748a6220f4 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:45.678895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:45.680132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:45.680713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:45.681183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] PATH_INFO: `/v3/users/aa2d83bcc02a43f89ba4785a9bdedd15` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:45.683082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2d83bcc02a43f89ba4785a9bdedd15)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:45.686133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:45.790386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2d83bcc02a43f89ba4785a9bdedd15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:45.804072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2d83bcc02a43f89ba4785a9bdedd15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:45.805052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2d83bcc02a43f89ba4785a9bdedd15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:45.805883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2d83bcc02a43f89ba4785a9bdedd15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:45.816228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d27909c-4e81-46d0-b3db-b28b268e34f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2d83bcc02a43f89ba4785a9bdedd15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:45.842884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1229/2427] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:45 2022] DELETE /identity/v3/users/aa2d83bcc02a43f89ba4785a9bdedd15 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:46.164553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.184368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9f35-d2f5-4f05-9062-b6b6a83ee21f service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.258448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.259519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.259815 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.260093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] PATH_INFO: `/v3/projects/2279e41c4ffe455d9f5d126d3d288333` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.261351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2279e41c4ffe455d9f5d126d3d288333)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.263290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.319810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2279e41c4ffe455d9f5d126d3d288333', 'request_id': 'req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:46.326491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2279e41c4ffe455d9f5d126d3d288333', 'request_id': 'req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:46.333895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2279e41c4ffe455d9f5d126d3d288333', 'request_id': 'req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:46.349066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] The token cache is being invalidate because project 2279e41c4ffe455d9f5d126d3d288333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:46.349361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:46.350041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c1fd8d-c35c-4d85-bc7a-26f8034c787a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:46.351597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1199/2428] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:46 2022] DELETE /identity/v3/projects/2279e41c4ffe455d9f5d126d3d288333 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:46.356518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.356921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.357204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.382564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:46.384293 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:46.455153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1230/2429] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:46.463253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.463548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.463837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.482165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:46.484086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:46.491961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1200/2430] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:46.496091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.505811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05ab85-3d71-489c-b63e-ae9c14a0533c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.510292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.510933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.511216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.511491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.512210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:46.512606 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.514328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.526028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1231/2431] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:05:46.530904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.540018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d8079-8d2c-483c-a750-eb8d8ef7071d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.544668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.546000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.546287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.546568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.547257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.549147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.573602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1201/2432] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:46.578033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.587580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6586-fac3-4000-bced-c8ca09645eb4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.643314 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.644083 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.644370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.644649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.645549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.648172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.669647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1232/2433] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:05:46.674049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.685165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70880-db98-4b02-89eb-c5cb721a7133 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.689902 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.690571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.690857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.691139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.691888 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.693504 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.705117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1202/2434] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:46.709296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.720460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3edc-c299-442a-a453-86c38dca9483 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.725229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.725921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.726211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.726516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.727250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.728904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad253-ab7c-44c8-b7f5-42dfabda14cc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.739210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1233/2435] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:46.743397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.756172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cb5-feea-46c2-8f00-ad2eb5d7adf0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.761603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.762572 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.762863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.763147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] PATH_INFO: `/v3/projects/411b53e128de4f1dac958385716f7553/users/33071d44ad5b49c5897f3d1f2f5816d4/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.780907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=411b53e128de4f1dac958385716f7553, user_id=33071d44ad5b49c5897f3d1f2f5816d4, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.783609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:46.798818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1203/2436] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:46 2022] PUT /identity/v3/projects/411b53e128de4f1dac958385716f7553/users/33071d44ad5b49c5897f3d1f2f5816d4/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:05:46.816695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.816953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.817238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.849846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] MFA Rules not processed for user `33071d44ad5b49c5897f3d1f2f5816d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:46.851052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:46.916696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1234/2437] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:05:46.921717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:46.987612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4836-95bd-4feb-af16-e3644a963dac admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:46.992208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:46.992864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:46.993152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:46.993431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:46.994156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:46.996050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.031394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1204/2438] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:46 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:47.032585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.043437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf045f4-dbb9-413b-9b05-1da804121a7b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.106411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.107084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.107443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.107825 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.108638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.111160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.137231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1235/2439] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:47 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:47.140196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.154494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f70aa-0567-429e-9d54-427716b714be admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.160342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.161021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.161500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.161817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.162615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.164132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.176039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1205/2440] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:47.180903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.205523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdda179-5381-466f-9654-fd401b21e69a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.205523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.205523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.205523 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.205919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] PATH_INFO: `/v3/projects/0c07382b75b546679da282acd2c6b0d6/users/11902abbf85b444c8a1003b2b22b122f/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.218896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c07382b75b546679da282acd2c6b0d6, user_id=11902abbf85b444c8a1003b2b22b122f, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.221609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.239479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1236/2441] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:47 2022] PUT /identity/v3/projects/0c07382b75b546679da282acd2c6b0d6/users/11902abbf85b444c8a1003b2b22b122f/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:47.243208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.253768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fecbbe-e3b8-4286-9574-fe0b951bc384 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.328527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.329205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.329514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.330292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.330666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.332345 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d9075-5f83-4258-b490-512e1ddc3e24 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.343647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1206/2442] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:47.347738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.359570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542808d-d91c-47d2-a184-d2183e007bf4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.368086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.369066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.369350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.369655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] PATH_INFO: `/v3/projects/0c07382b75b546679da282acd2c6b0d6/users/11902abbf85b444c8a1003b2b22b122f/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.371765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c07382b75b546679da282acd2c6b0d6, user_id=11902abbf85b444c8a1003b2b22b122f, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.375257 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.387843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1237/2443] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:47 2022] PUT /identity/v3/projects/0c07382b75b546679da282acd2c6b0d6/users/11902abbf85b444c8a1003b2b22b122f/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:47.398027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.398584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.399070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.427021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] MFA Rules not processed for user `11902abbf85b444c8a1003b2b22b122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:47.428240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:47.503875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1207/2444] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:47.516445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.518268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:47.577815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b244c-3a3f-4be4-b428-5251a00a56d6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.581819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.582535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.582749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.583026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.592279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.593762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.603076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1238/2445] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:47.681488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:47.691588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3289-c6be-4fd7-8992-9e9ff060900e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:47.695210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:47.695852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:47.696135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:47.696411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:47.754066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:47.755493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31618ced-a4ea-4f31-80c1-8a6fbdb8af95 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:47.765017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1208/2446] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:56.999547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:57.001034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:57.069659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317aee2-a3e8-4e49-b30d-444528834c04 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:57.074185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:57.074992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:57.075262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:57.075536 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] PATH_INFO: `/v3/users/b5c2313bc51d4035986a8c4568a5e060` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:57.077589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c2313bc51d4035986a8c4568a5e060)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:57.079510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:57.140015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c2313bc51d4035986a8c4568a5e060'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:57.153733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c2313bc51d4035986a8c4568a5e060'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:57.154492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c2313bc51d4035986a8c4568a5e060'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:57.155395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c2313bc51d4035986a8c4568a5e060'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:57.162264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c2313bc51d4035986a8c4568a5e060'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:57.176063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1239/2447] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:56 2022] DELETE /identity/v3/users/b5c2313bc51d4035986a8c4568a5e060 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:57.180397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:57.180862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:57.180977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:57.208993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:57.210242 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:57.275472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1209/2448] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:57.296898 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:57.298693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:57.386386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700a10-12f7-4470-9b52-96afc63979b0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:57.392569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:57.393735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:57.394250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:57.394730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:57.405580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:57.407398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:57.418743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1240/2449] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:05:58.187624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:58.189812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:58.212350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824ab07-0442-44dd-84e0-eae1f871f893 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:58.217836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:58.218810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:58.219311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:58.219658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] PATH_INFO: `/v3/projects/1e75b460d7804911a42e68ea34563308` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:58.221252 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e75b460d7804911a42e68ea34563308)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:58.224107 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:58.276564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e75b460d7804911a42e68ea34563308', 'request_id': 'req-c32e5b02-6053-4c4d-becd-3b1660200f27'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.288918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e75b460d7804911a42e68ea34563308', 'request_id': 'req-c32e5b02-6053-4c4d-becd-3b1660200f27'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.300324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e75b460d7804911a42e68ea34563308', 'request_id': 'req-c32e5b02-6053-4c4d-becd-3b1660200f27'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.319873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] The token cache is being invalidate because project 1e75b460d7804911a42e68ea34563308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:58.320167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.320818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.322493 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1210/2450] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:58 2022] DELETE /identity/v3/projects/1e75b460d7804911a42e68ea34563308 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:58.327005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:58.337908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a0b10-40f9-49dd-a513-b62caaecfd5c service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:58.419352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:58.421674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:58.422706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:58.423202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] PATH_INFO: `/v3/users/9060dcb5ddbf4d28ae294a3972b3dcef` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:58.424594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9060dcb5ddbf4d28ae294a3972b3dcef)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:58.426690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:58.490762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9060dcb5ddbf4d28ae294a3972b3dcef'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.504187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9060dcb5ddbf4d28ae294a3972b3dcef'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.505002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9060dcb5ddbf4d28ae294a3972b3dcef'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.505791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9060dcb5ddbf4d28ae294a3972b3dcef'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.514401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-12fd8cbc-5f94-4248-aa49-1a5bf1506402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9060dcb5ddbf4d28ae294a3972b3dcef'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:58.527010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1241/2451] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:05:58 2022] DELETE /identity/v3/users/9060dcb5ddbf4d28ae294a3972b3dcef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:58.845273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:58.847027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:58.877640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e5b02-6053-4c4d-becd-3b1660200f27 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:58.979206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:58.980362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:58.980851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:58.981305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] PATH_INFO: `/v3/projects/d2197537db5d4b609d7bad01e178b8e5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:58.983244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2197537db5d4b609d7bad01e178b8e5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:58.985570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.067787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2197537db5d4b609d7bad01e178b8e5', 'request_id': 'req-65d78bd6-e1d6-42c2-b136-a0326c8a897c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:59.074212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2197537db5d4b609d7bad01e178b8e5', 'request_id': 'req-65d78bd6-e1d6-42c2-b136-a0326c8a897c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:59.084916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2197537db5d4b609d7bad01e178b8e5', 'request_id': 'req-65d78bd6-e1d6-42c2-b136-a0326c8a897c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:59.106338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] The token cache is being invalidate because project d2197537db5d4b609d7bad01e178b8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:05:59.106796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:59.107634 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-65d78bd6-e1d6-42c2-b136-a0326c8a897c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:05:59.109767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1211/2452] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:05:58 2022] DELETE /identity/v3/projects/d2197537db5d4b609d7bad01e178b8e5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:59.121275 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.121988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.124125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.147241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:59.148592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:59.242464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1242/2453] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:59.248949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.249367 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.249611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.272949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:59.274431 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:59.286520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1212/2454] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:59.287651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.297655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a88fe-b188-4f75-878a-c77a0382aba2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.303001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.304266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.304555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.304833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.305607 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:05:59.306525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.308159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.324556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1243/2455] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:05:59.328827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.339337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71d03-cd99-4cea-814d-7449deb1a994 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.345363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.346121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.346432 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.346705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.347407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.349324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.376174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1213/2456] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:59.380576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.392460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310ef78-f3a8-489f-ad61-8f61c9d2a637 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.449942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.450532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.451362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.451639 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.452320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.454300 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.477884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1244/2457] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:59.479056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.489204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf056-0c18-4965-8f54-9df770c42c4a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.494424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.495414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.495936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.496421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.497399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.501409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.517509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1214/2458] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:05:59.520280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.531525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88f675-249c-4430-87a1-f860d7248d53 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.536239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.536970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.537291 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.537609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.538353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.539960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ea15-06ba-4cae-9e7b-e04231bd7dcf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.551063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1245/2459] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:59.554910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.565622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f038772-4c46-4def-a569-0fd838619baa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.570383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.571253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.571538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.571816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] PATH_INFO: `/v3/projects/449d9f22e9e141b79cb79c8097fa6f1b/users/fb2f69af8c404987ad4ba68e31c5e934/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.586537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449d9f22e9e141b79cb79c8097fa6f1b, user_id=fb2f69af8c404987ad4ba68e31c5e934, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.589204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.602649 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1215/2460] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:59 2022] PUT /identity/v3/projects/449d9f22e9e141b79cb79c8097fa6f1b/users/fb2f69af8c404987ad4ba68e31c5e934/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:05:59.613688 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.613982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.614267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.644994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] MFA Rules not processed for user `fb2f69af8c404987ad4ba68e31c5e934`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:05:59.646239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:05:59.712917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1246/2461] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:05:59.718070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.782152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2f67-02d9-4a5c-a644-fbb272791066 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.786937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.787602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.787894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.788182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.788916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.791031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.819010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1216/2462] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:59.828522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.840765 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffef35-5778-4348-af43-a3577a237ea2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.912571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.913279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.913632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.913916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.914785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.917001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.943541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1247/2463] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:05:59 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:05:59.944976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.956833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30b60-8a52-450b-99d5-69c07c75a63a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.961940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.962614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.962901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.963236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:05:59.963916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:05:59.965554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:05:59.976628 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1217/2464] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:05:59.980892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:05:59.992554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d478da-b7d0-4e32-a51b-ea735d54567b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:05:59.997399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:05:59.998853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:05:59.999164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:05:59.999441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] PATH_INFO: `/v3/projects/daf18d869fa7468ea9f086ff1956cdf0/users/921097d9d05b4f95b91c285a57b2658a/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.015021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf18d869fa7468ea9f086ff1956cdf0, user_id=921097d9d05b4f95b91c285a57b2658a, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:00.018131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:00.031065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1248/2465] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:05:59 2022] PUT /identity/v3/projects/daf18d869fa7468ea9f086ff1956cdf0/users/921097d9d05b4f95b91c285a57b2658a/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:00.035134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:00.046692 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d678d-4e8f-42bd-a889-8b292d862a17 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:00.114667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:00.115622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.116659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.117071 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.118565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:00.120283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a43e9-3173-47fb-afc6-68a3e25fe79b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:00.135475 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1218/2466] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:00.137615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:00.149305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23fba3-f7b3-468f-a680-3232355a31e6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:00.154472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:00.155355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.155621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.155899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] PATH_INFO: `/v3/projects/daf18d869fa7468ea9f086ff1956cdf0/users/921097d9d05b4f95b91c285a57b2658a/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.159437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf18d869fa7468ea9f086ff1956cdf0, user_id=921097d9d05b4f95b91c285a57b2658a, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:00.162305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:00.190159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1249/2467] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:00 2022] PUT /identity/v3/projects/daf18d869fa7468ea9f086ff1956cdf0/users/921097d9d05b4f95b91c285a57b2658a/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:00.202635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270f06-fd52-42b3-a356-1ae5cf0d2c43 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.203053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270f06-fd52-42b3-a356-1ae5cf0d2c43 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.204021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270f06-fd52-42b3-a356-1ae5cf0d2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.242532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6c270f06-fd52-42b3-a356-1ae5cf0d2c43 None None] MFA Rules not processed for user `921097d9d05b4f95b91c285a57b2658a`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:00.244040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c270f06-fd52-42b3-a356-1ae5cf0d2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:00.329977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1219/2468] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:00.342944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:00.345159 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:00.458700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679a5f-e29e-4da1-a6bb-909a9a1b6f64 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:00.466032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:00.467247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.467777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.468281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.488585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.488968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.489357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.502231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:00.504179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:00.518909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1250/2469] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:00.522542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] MFA Rules not processed for user `34e24c80364642b083dc32697f7320ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:00.524316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:00.579327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:00.592802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e72c-ca34-4ec7-8500-a9c4f608b0fa service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:00.596813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:00.597460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.597780 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.598060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.605720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1220/2470] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:00.666484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:00.667505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:00.678060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1251/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:00.809641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:00.811715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:00.907514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9507-d428-44b0-b5f6-cf99bfaf57e8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:00.912911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:00.913746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:00.914139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:00.914514 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:00.917246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:01.014487 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:01.018818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:01.040583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1221/2472] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:03.773990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:03.776806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:03.792885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d2ad-4a96-42cb-8382-e25a98ffaf66 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:03.806776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:03.806776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:03.806776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:03.806776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:03.812830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:03.968579 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:03.971448 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eefcc1-c696-445f-a30c-bcac251f655d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:03.986452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1252/2473] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:04.485942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:04.498290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63a47-0b27-40a4-a91b-bcfaca34f7f3 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:04.504204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:04.505282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:04.505787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:04.506233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] PATH_INFO: `/v3/users/fb2f69af8c404987ad4ba68e31c5e934` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:04.507664 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2f69af8c404987ad4ba68e31c5e934)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:04.510055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:04.585120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2f69af8c404987ad4ba68e31c5e934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:04.605325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2f69af8c404987ad4ba68e31c5e934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:04.614859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2f69af8c404987ad4ba68e31c5e934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:04.615718 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2f69af8c404987ad4ba68e31c5e934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:04.616425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2f69af8c404987ad4ba68e31c5e934'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:04.630258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1222/2474] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:04 2022] DELETE /identity/v3/users/fb2f69af8c404987ad4ba68e31c5e934 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:04.635175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:04.635882 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:04.636331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:04.661998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:04.663561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:04.797030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1253/2475] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:04.807255 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:04.808956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:04.881946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7791e2-b1fc-4587-8ea7-3645a28787ad admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:04.885486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:04.886220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:04.886506 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:04.886794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:04.896873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:04.898369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:04.908743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1223/2476] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:05.199008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:05.201508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:05.220145 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4da1e9-3809-4527-88e6-2553edaa0707 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:05.225401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:05.226561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:05.227328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:05.227957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] PATH_INFO: `/v3/projects/449d9f22e9e141b79cb79c8097fa6f1b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:05.230999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449d9f22e9e141b79cb79c8097fa6f1b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:05.235493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:05.291478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449d9f22e9e141b79cb79c8097fa6f1b', 'request_id': 'req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.297352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449d9f22e9e141b79cb79c8097fa6f1b', 'request_id': 'req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.305277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449d9f22e9e141b79cb79c8097fa6f1b', 'request_id': 'req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.319070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] The token cache is being invalidate because project 449d9f22e9e141b79cb79c8097fa6f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:05.319362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.320015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.321916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1254/2477] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:05 2022] DELETE /identity/v3/projects/449d9f22e9e141b79cb79c8097fa6f1b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:05.325658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:05.335364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9db49-a5b2-4971-898b-e58beff35c6c service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:05.408331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:05.409208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:05.409643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:05.409927 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] PATH_INFO: `/v3/users/921097d9d05b4f95b91c285a57b2658a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:05.411176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=921097d9d05b4f95b91c285a57b2658a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:05.413213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:05.461183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921097d9d05b4f95b91c285a57b2658a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.473714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921097d9d05b4f95b91c285a57b2658a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.480748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921097d9d05b4f95b91c285a57b2658a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.481528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921097d9d05b4f95b91c285a57b2658a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.482197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1cb450fb-9db2-4d07-a732-c08382d18999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921097d9d05b4f95b91c285a57b2658a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:05.494988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1224/2478] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:05 2022] DELETE /identity/v3/users/921097d9d05b4f95b91c285a57b2658a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:05.930775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:05.932966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:05.945897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e5fe-83d5-4cd9-b9a6-5c0bd2b9d613 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.014442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.015633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.015924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.016625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] PATH_INFO: `/v3/projects/daf18d869fa7468ea9f086ff1956cdf0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.017706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf18d869fa7468ea9f086ff1956cdf0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.019760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.067051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf18d869fa7468ea9f086ff1956cdf0', 'request_id': 'req-fc281bbd-f8c9-4671-967e-61c1f70013cf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:06.072727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf18d869fa7468ea9f086ff1956cdf0', 'request_id': 'req-fc281bbd-f8c9-4671-967e-61c1f70013cf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:06.080623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf18d869fa7468ea9f086ff1956cdf0', 'request_id': 'req-fc281bbd-f8c9-4671-967e-61c1f70013cf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:06.091715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] The token cache is being invalidate because project daf18d869fa7468ea9f086ff1956cdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:06.092016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:06.092655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fc281bbd-f8c9-4671-967e-61c1f70013cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:06.094578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1255/2479] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:05 2022] DELETE /identity/v3/projects/daf18d869fa7468ea9f086ff1956cdf0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:06.099145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.099618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.099910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.118351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:06.119565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:06.181756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1225/2480] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:06.189925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.190289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.190659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.208926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:06.210253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:06.218360 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1256/2481] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:06.222535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.232464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689138-7c6d-44c8-aa6d-a5bc33b5bf0c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.237050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.237738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.238025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.238303 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.239027 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:06.239337 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.240936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.256118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1226/2482] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:06:06.257340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.267218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b582-ef42-4ad0-ace9-f98298215018 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.279322 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.280271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.280689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.281098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.281958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.283987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.310925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1257/2483] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:06.315860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.327094 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadf16e-7039-4482-9660-363d262073fe admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.394835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.395600 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.395895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.397509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.397509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.398850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.431176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1227/2484] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:06.436170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.448519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8476-27b8-48df-a3a9-36fa0380af89 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.460264 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.461837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.462228 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.462740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.464063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.467678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.480299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1258/2485] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:06.485115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.495581 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69f786-eca6-4fc6-a7f6-e7111be62804 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.502558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.503633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.504085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.504534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.505429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.507267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4743a-90ae-4283-bea5-4b1c2182b4f4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.519779 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1228/2486] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:06.523795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.537044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de94c4-4c66-4031-bad1-7a8791527317 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.543031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.543965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.544879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.545169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] PATH_INFO: `/v3/projects/cde21f70a15340d7a6c40eb1883778f5/users/4335f00fbf114ff1bf92286d886abe13/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.562341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde21f70a15340d7a6c40eb1883778f5, user_id=4335f00fbf114ff1bf92286d886abe13, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.565828 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.590418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1259/2487] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:06 2022] PUT /identity/v3/projects/cde21f70a15340d7a6c40eb1883778f5/users/4335f00fbf114ff1bf92286d886abe13/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:06.601938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.602228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.602512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.632643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] MFA Rules not processed for user `4335f00fbf114ff1bf92286d886abe13`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:06.633810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:06.721715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1229/2488] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:06.726341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.808537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939bf3a-29ab-41e6-9c3b-55fde6500156 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.814178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.814938 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.815344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.815714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.816494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.818644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.864441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1260/2489] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:06.868528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:06.881223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0a474-1a31-4c6a-bcb4-2bcbbf5b39af None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:06.969425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:06.969996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:06.970284 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:06.970563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:06.971269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:06.973366 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:06.995765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1230/2490] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:06 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:07.000062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.010559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d17aa6-a5b6-4818-85b4-67cd8fd61f11 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.018324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.019025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.019311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.019761 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.021177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.022824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.037654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1261/2491] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:07.041426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.052414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c465d22-1239-4239-99ef-2906ee776896 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.065836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.066849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.066946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.067257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] PATH_INFO: `/v3/projects/da18ef631ee54d67a49f74d1920f16c0/users/990ca0b7f104414fb04a9022ab8c36d6/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.083743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da18ef631ee54d67a49f74d1920f16c0, user_id=990ca0b7f104414fb04a9022ab8c36d6, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.086663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.106873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1231/2492] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:07 2022] PUT /identity/v3/projects/da18ef631ee54d67a49f74d1920f16c0/users/990ca0b7f104414fb04a9022ab8c36d6/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:07.108172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.118394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6fdd-5790-4789-96b9-576960e1b4c6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.204051 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.204814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.205165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.205543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.206346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.208022 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323550c2-ed99-4709-9244-2a6dea9a1d8a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.218891 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1262/2493] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:07.223013 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.233882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a75b-c5f0-45c1-bfa3-84c283c1412e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.240428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.241627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.242404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.242849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] PATH_INFO: `/v3/projects/da18ef631ee54d67a49f74d1920f16c0/users/990ca0b7f104414fb04a9022ab8c36d6/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.248800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da18ef631ee54d67a49f74d1920f16c0, user_id=990ca0b7f104414fb04a9022ab8c36d6, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.252177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.275615 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1232/2494] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:07 2022] PUT /identity/v3/projects/da18ef631ee54d67a49f74d1920f16c0/users/990ca0b7f104414fb04a9022ab8c36d6/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:07.278196 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.279124 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.279700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.314048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] MFA Rules not processed for user `990ca0b7f104414fb04a9022ab8c36d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:07.317143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:07.429061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1263/2495] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:07.440381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.442275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:07.504569 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799fe6-af61-4b83-a6c9-f4d7da338487 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.508776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.509444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.510545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.510843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.521265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.522804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f46753-9816-452e-aba2-322398cd03ac service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.533422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1233/2496] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:07.608446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:07.686956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f91323-d6d2-42fc-86b6-bc091356d0ed None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:07.691496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:07.692361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.692643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.692921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] PATH_INFO: `/v3/users/4335f00fbf114ff1bf92286d886abe13` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.694131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4335f00fbf114ff1bf92286d886abe13)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:07.696072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:07.792408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4335f00fbf114ff1bf92286d886abe13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:07.808231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4335f00fbf114ff1bf92286d886abe13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:07.809107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4335f00fbf114ff1bf92286d886abe13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:07.809869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4335f00fbf114ff1bf92286d886abe13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:07.822078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4335f00fbf114ff1bf92286d886abe13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:07.846643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1264/2497] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:07 2022] DELETE /identity/v3/users/4335f00fbf114ff1bf92286d886abe13 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:07.852582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:07.852880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:07.853162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:07.911318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:07.923991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.024717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1234/2498] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:08.034543 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.039776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.127173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c1cf-5385-4a8e-acd2-5ca219d1bf8a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.131147 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:08.131829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.132121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.132409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.144341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:08.148870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:08.177601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1265/2499] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:08.344179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.347397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.377026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7bcef-5ce6-4b75-97e3-59e247f9dd2b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.381964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:08.382931 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.383341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.383748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] PATH_INFO: `/v3/users/8396cfed6d904f859ade91e210c619b5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.385188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8396cfed6d904f859ade91e210c619b5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:08.387260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:08.444258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8396cfed6d904f859ade91e210c619b5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.459025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8396cfed6d904f859ade91e210c619b5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.467802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8396cfed6d904f859ade91e210c619b5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.468650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8396cfed6d904f859ade91e210c619b5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.469335 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8396cfed6d904f859ade91e210c619b5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.484464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1235/2500] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:08 2022] DELETE /identity/v3/users/8396cfed6d904f859ade91e210c619b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:08.527611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.529215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.549858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df863-eec9-4879-883f-7384588d9faa service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.616512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:08.617376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.617767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.618143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] PATH_INFO: `/v3/projects/cde21f70a15340d7a6c40eb1883778f5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.619346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde21f70a15340d7a6c40eb1883778f5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:08.621256 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:08.679008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde21f70a15340d7a6c40eb1883778f5', 'request_id': 'req-491ca676-d688-43a5-a25a-e447068d1d47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.687465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde21f70a15340d7a6c40eb1883778f5', 'request_id': 'req-491ca676-d688-43a5-a25a-e447068d1d47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.694151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.696384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.696601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde21f70a15340d7a6c40eb1883778f5', 'request_id': 'req-491ca676-d688-43a5-a25a-e447068d1d47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.710222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] The token cache is being invalidate because project cde21f70a15340d7a6c40eb1883778f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:08.710515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.711173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.711729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033aec2-0cf1-4ec9-bab3-c83a291c65ee admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.712920 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1266/2501] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:08 2022] DELETE /identity/v3/projects/cde21f70a15340d7a6c40eb1883778f5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:08.717238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.718966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.774162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:08.775032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.775320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.775603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] PATH_INFO: `/v3/projects/1f4f0f35ae0b4c94977f2e1688dbdb5c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.776783 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4f0f35ae0b4c94977f2e1688dbdb5c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:08.778796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:08.783266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ca676-d688-43a5-a25a-e447068d1d47 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.788101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:08.789019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.789295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.789604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] PATH_INFO: `/v3/users/990ca0b7f104414fb04a9022ab8c36d6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.790812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990ca0b7f104414fb04a9022ab8c36d6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:08.792743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:08.826580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'request_id': 'req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.832301 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'request_id': 'req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.838391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990ca0b7f104414fb04a9022ab8c36d6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.838713 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'request_id': 'req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.851285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990ca0b7f104414fb04a9022ab8c36d6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.851614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] The token cache is being invalidate because project 1f4f0f35ae0b4c94977f2e1688dbdb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:08.852011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.852217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990ca0b7f104414fb04a9022ab8c36d6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.852834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990ca0b7f104414fb04a9022ab8c36d6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.852959 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fdd3f76e-fa30-4ae3-a831-2eda10dd72d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.854644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1236/2502] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:08 2022] DELETE /identity/v3/projects/1f4f0f35ae0b4c94977f2e1688dbdb5c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:08.859515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.859860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.860226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.861747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c42cfd21-788c-43d6-a8ec-a0e7e3f37814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990ca0b7f104414fb04a9022ab8c36d6'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:08.875139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1267/2503] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:08 2022] DELETE /identity/v3/users/990ca0b7f104414fb04a9022ab8c36d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:08.879020 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:08.880261 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.940813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1237/2504] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:08.949749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:08.950008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:08.950916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:08.969242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:08.970520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:08.979564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1268/2505] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:08.984942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:08.994646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e5dec-6ec9-4af9-9a37-b945d0028b9b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:08.999449 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.000258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.000671 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.001040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.002062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:09.002371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.004192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.016667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1238/2506] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:09.020831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.031292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67901-7d54-43a1-9ee1-1741d68bca17 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.036025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.036719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.036990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.037267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.037987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.039932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.066887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1269/2507] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:09.071187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.081310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67dcae-9bbc-4f15-b9a9-6570bd513823 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.139494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.140119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.140687 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.140949 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.141729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.143601 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.152582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.155258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.168226 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1239/2508] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:09.170025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062dd8c-11c1-41a1-bd35-fa51e91eb05d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.172726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.183548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.185594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.186066 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.186545 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] PATH_INFO: `/v3/projects/da18ef631ee54d67a49f74d1920f16c0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.187424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7603-e0e9-45ec-8a97-8ca33ce93a0a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.188432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da18ef631ee54d67a49f74d1920f16c0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.190501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.192003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.192661 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.192947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.193227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.194042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.195648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.207439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1240/2509] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:09.212576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.223425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcf49-1284-464b-bd89-82ebc677528e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.229193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.229922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.230383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.230473 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.231595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.233808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.253178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1241/2510] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:09.254502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.258696 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da18ef631ee54d67a49f74d1920f16c0', 'request_id': 'req-fb385f6c-4713-48d6-93c3-184cc955f873'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:09.266330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da18ef631ee54d67a49f74d1920f16c0', 'request_id': 'req-fb385f6c-4713-48d6-93c3-184cc955f873'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:09.270707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848686b-d1c3-4a70-818c-37869a709a12 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.277041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da18ef631ee54d67a49f74d1920f16c0', 'request_id': 'req-fb385f6c-4713-48d6-93c3-184cc955f873'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:09.290017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] The token cache is being invalidate because project da18ef631ee54d67a49f74d1920f16c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:09.290677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:09.291438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fb385f6c-4713-48d6-93c3-184cc955f873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:09.297716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1270/2511] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:09 2022] DELETE /identity/v3/projects/da18ef631ee54d67a49f74d1920f16c0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:09.299248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445a7e-773c-4e91-8ca7-6edced795b96 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.299638 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445a7e-773c-4e91-8ca7-6edced795b96 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.300671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445a7e-773c-4e91-8ca7-6edced795b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.328833 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-16445a7e-773c-4e91-8ca7-6edced795b96 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:09.330183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-16445a7e-773c-4e91-8ca7-6edced795b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.347656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.348961 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.349257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.349575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] PATH_INFO: `/v3/projects/3733fcc038424890ab4b67f53e9dda26/users/e4f910b7074e4099a8d8bc1002c522fb/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.368795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3733fcc038424890ab4b67f53e9dda26, user_id=e4f910b7074e4099a8d8bc1002c522fb, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.372138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f2d54-cf4f-4bfd-92d0-ef711b1974a2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.425610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1242/2512] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:09 2022] PUT /identity/v3/projects/3733fcc038424890ab4b67f53e9dda26/users/e4f910b7074e4099a8d8bc1002c522fb/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:09.429580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1271/2513] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:09.434901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.435398 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.435567 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.436151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.437640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.438201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.460090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:09.461432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.491491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] MFA Rules not processed for user `e4f910b7074e4099a8d8bc1002c522fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:09.493033 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.538503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1272/2514] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:09.542826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.559217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a40802-7969-4c01-9f67-92bec10865f8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.568656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.569431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.569829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.569979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.570713 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:09.571077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.572687 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.591747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1273/2515] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:06:09.595929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.612132 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c92e-c296-43cd-8f5b-d5715d32b790 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.612265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1243/2516] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:09.624825 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.627078 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.627848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.628529 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.628863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.629166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.629895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.631808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.663520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1274/2517] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/projects => generated 409 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:09.667819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.716748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e4f8-e991-4e91-ac76-125468628145 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.733857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172699-a520-43a8-9f31-e515ca09ead3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.738798 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.739476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.739921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.740248 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.740907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.742885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.766131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1275/2518] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:09.770357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.783299 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2479-e29d-40de-b08f-0a1dfbe2af17 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.785277 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.785970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.786253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.786530 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.787967 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.788623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.788941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.789217 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.790019 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.791574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.801834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1276/2519] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:09.805535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.816674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2608-4396-46ef-bf5c-2a26cad69111 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.821850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.822514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.822802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.823082 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.823811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.826231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.836975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1277/2520] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:09.840911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:09.848067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.849704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71025e-b620-40e2-a89a-ce97c4748e00 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.850192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15864e88-5db6-4197-9395-8d8520a92c3a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:09.855065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:09.855927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.856215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.857069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] PATH_INFO: `/v3/projects/4f06341ab0a449e7ad74ee13cbb053cc/users/e8195391d0b64e3a8396287fa61d4eb3/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.860976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1244/2521] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:09.871754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f06341ab0a449e7ad74ee13cbb053cc, user_id=e8195391d0b64e3a8396287fa61d4eb3, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:09.875104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:09.888866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1278/2522] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:09 2022] PUT /identity/v3/projects/4f06341ab0a449e7ad74ee13cbb053cc/users/e8195391d0b64e3a8396287fa61d4eb3/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:09.900375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:09.900669 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:09.900950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:09.928515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] MFA Rules not processed for user `e8195391d0b64e3a8396287fa61d4eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:09.929869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:09.992618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1245/2523] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:09.997156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.062394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eb0d2-9117-4af4-86f0-bd6bfc2b9a34 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.067000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.067653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.067935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.068210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.068895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.070834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.097505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1279/2524] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:09 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:10.101560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.118714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a033ea-7504-49b5-b0cf-67e9dcf5476f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.179558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.180253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.180538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.180823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.181647 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.183587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.212343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1246/2525] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:10 2022] POST /identity/v3/users => generated 310 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:10.216703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.227895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711580-5f5d-4571-a2d1-964acfc6866d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.235324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.236075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.236431 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.236808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.237714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.239327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.250871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1280/2526] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:10.255128 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.264941 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1635b-6580-4490-92ed-0e8238873f58 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.269840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.270708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.270993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.271276 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] PATH_INFO: `/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd/users/bac0fc1af59540028239486113e1c75c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.285882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fe838e8794a7bbc13a5e57f8b5ecd, user_id=bac0fc1af59540028239486113e1c75c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.288516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.301197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1247/2527] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:10 2022] PUT /identity/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd/users/bac0fc1af59540028239486113e1c75c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:10.305187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.314930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11090-4f07-48ee-bbb9-44bbf1645e72 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.369179 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.369879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.370164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.370442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.371193 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.372785 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8d1a-4191-491e-abd1-e20811ba45c8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.382183 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1281/2528] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:10.386304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.396808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d4a38-d695-40ea-b546-8e061b1d180d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.401607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.402480 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.402768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.403102 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] PATH_INFO: `/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd/users/bac0fc1af59540028239486113e1c75c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.405733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fe838e8794a7bbc13a5e57f8b5ecd, user_id=bac0fc1af59540028239486113e1c75c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.408415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.419652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1248/2529] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:10 2022] PUT /identity/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd/users/bac0fc1af59540028239486113e1c75c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:10.429386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.429711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.429996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.456172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] MFA Rules not processed for user `bac0fc1af59540028239486113e1c75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:10.457361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:10.527002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1282/2530] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:10.546721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.548568 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:10.606125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce075ea-d8ea-4643-97e8-def78aa788bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.610406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.611052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.611341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.611624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.620648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.622159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.631558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1249/2531] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:10.808115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:10.817376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03bb3-7a00-400a-a8e6-43f04f019823 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:10.820867 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:10.821527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:10.821815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:10.822089 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:10.881982 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:10.883526 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a5b28-5556-4d37-9753-d4778121fa6c service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:10.895136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1283/2532] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:25.496621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:25.496621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:25.562593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d852-a57e-4a38-82a6-024aa3d08736 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:25.567597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:25.568806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:25.569308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:25.569824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] PATH_INFO: `/v3/users/e4f910b7074e4099a8d8bc1002c522fb` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:25.571292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f910b7074e4099a8d8bc1002c522fb)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:25.573444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:25.643889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f910b7074e4099a8d8bc1002c522fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:25.661248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f910b7074e4099a8d8bc1002c522fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:25.668624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f910b7074e4099a8d8bc1002c522fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:25.669437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f910b7074e4099a8d8bc1002c522fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:25.670461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f910b7074e4099a8d8bc1002c522fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:25.699021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1250/2533] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:25 2022] DELETE /identity/v3/users/e4f910b7074e4099a8d8bc1002c522fb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:25.704820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290479-956f-4046-af12-577777acc278 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:25.705422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290479-956f-4046-af12-577777acc278 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:25.705640 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290479-956f-4046-af12-577777acc278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:25.724346 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0e290479-956f-4046-af12-577777acc278 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:25.725678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0e290479-956f-4046-af12-577777acc278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:25.806711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1284/2534] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:25.819919 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:25.821363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:25.886217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e8c2-0670-4ff2-bc36-f42ec81f67b3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:25.891375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:25.892087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:25.892377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:25.892658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:25.902306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:25.903746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:25.914452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1251/2535] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:26.275460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e290479-956f-4046-af12-577777acc278 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.276876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0e290479-956f-4046-af12-577777acc278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:26.316721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.317983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:26.339062 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b58e-ac44-445e-b8bf-513ace0fd3c9 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.345120 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.347184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.347651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.347999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] PATH_INFO: `/v3/projects/3733fcc038424890ab4b67f53e9dda26` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.349983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3733fcc038424890ab4b67f53e9dda26)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.353544 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.385013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e290479-956f-4046-af12-577777acc278 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.391758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.392464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.392732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.393012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.394871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:26.405866 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3733fcc038424890ab4b67f53e9dda26', 'request_id': 'req-4602229d-27c5-470b-b610-028aae44184b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:26.407784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.409381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d27b-473e-4b96-81a5-989be49e0deb service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.411439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3733fcc038424890ab4b67f53e9dda26', 'request_id': 'req-4602229d-27c5-470b-b610-028aae44184b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:26.417435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3733fcc038424890ab4b67f53e9dda26', 'request_id': 'req-4602229d-27c5-470b-b610-028aae44184b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:26.419250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1285/2536] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:26.431611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] The token cache is being invalidate because project 3733fcc038424890ab4b67f53e9dda26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:26.431900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:26.432517 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4602229d-27c5-470b-b610-028aae44184b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:26.434091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1252/2537] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:26 2022] DELETE /identity/v3/projects/3733fcc038424890ab4b67f53e9dda26 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:26.439754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.440099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.440382 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.459032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:26.460230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:26.518830 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1286/2538] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:26.526390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.526846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.526967 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.545520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:26.546734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:26.554623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1253/2539] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:26.558814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.569401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4ff93-2433-4666-8f5d-ae84c3e713cc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.574892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.575554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.575856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.576181 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.576926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:26.577213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.578855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.590165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1287/2540] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:26.595052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.604006 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57467e36-38c9-4725-8eb9-2c7b2daf7b32 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.609937 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.610598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.610887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.611168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.611869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.613821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.640556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1254/2541] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:26 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:26.644429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.655575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071ea1-3823-4784-b40f-aa8c97023f6b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.715129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.715943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.716063 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.716334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.717801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.719779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.740888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1288/2542] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:26 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:26.745311 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.755829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922c2a-5565-441d-996c-546aff7639da admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.760657 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.761325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.761637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.761916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.762641 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.764313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.775798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1255/2543] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:26.780599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.790914 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61479fc-3ce9-4b27-b797-4d25736a61d7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.796086 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.796735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.797021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.797301 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.798062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.799658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20502d-d95b-4fec-9537-6d8bfcabf379 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.809875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1289/2544] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:26.814168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:26.824412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3828e-1873-4382-ab28-b0e762729de5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:26.829845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:26.830725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.831064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.831360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] PATH_INFO: `/v3/projects/5477d6af43c84c988b0597e0d77231fc/users/08ce1e9bd5804bd7bbb47a970fc8c001/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.853268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5477d6af43c84c988b0597e0d77231fc, user_id=08ce1e9bd5804bd7bbb47a970fc8c001, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:26.855953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:26.872054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1256/2545] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:26 2022] PUT /identity/v3/projects/5477d6af43c84c988b0597e0d77231fc/users/08ce1e9bd5804bd7bbb47a970fc8c001/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:26.885091 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:26.885404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:26.885704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:26.933966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] MFA Rules not processed for user `08ce1e9bd5804bd7bbb47a970fc8c001`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:26.936386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.050495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1290/2546] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:27.058088 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:27.060213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.139524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a56f7-74f4-43b1-ae04-bca07704e083 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:27.145368 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103951448cfc47bbb702f2117cc5b362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:27.145991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.146280 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.146557 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.155463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:27.157082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:27.166040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1257/2547] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:27.391112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:27.457102 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b3c34-9c74-4d75-bae2-50dc5ff89b79 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:27.461865 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:27.462963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.463259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.463582 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] PATH_INFO: `/v3/users/08ce1e9bd5804bd7bbb47a970fc8c001` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.464852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ce1e9bd5804bd7bbb47a970fc8c001)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:27.467560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:27.512647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ce1e9bd5804bd7bbb47a970fc8c001'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.524515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ce1e9bd5804bd7bbb47a970fc8c001'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.525195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ce1e9bd5804bd7bbb47a970fc8c001'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.525819 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ce1e9bd5804bd7bbb47a970fc8c001'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.533398 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66cdc9be-9b6c-4b85-91e3-95adfdfa78ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ce1e9bd5804bd7bbb47a970fc8c001'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.541152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:27.542962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.546476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1291/2548] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:27 2022] DELETE /identity/v3/users/08ce1e9bd5804bd7bbb47a970fc8c001 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:27.550775 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.551073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.551353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.557379 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66510-0214-4a78-8acc-123db8efe023 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:27.568169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:27.569417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.615101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:27.615973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.616262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.616543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] PATH_INFO: `/v3/users/e8195391d0b64e3a8396287fa61d4eb3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.617757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8195391d0b64e3a8396287fa61d4eb3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:27.619680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:27.626580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1292/2549] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:27.636244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:27.637622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.669417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8195391d0b64e3a8396287fa61d4eb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.682031 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8195391d0b64e3a8396287fa61d4eb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.689230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8195391d0b64e3a8396287fa61d4eb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.689952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8195391d0b64e3a8396287fa61d4eb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.690563 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9565bcd0-0e88-4776-9681-cd511f66e1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8195391d0b64e3a8396287fa61d4eb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:27.698659 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97fb94-cbd2-411b-83cf-d318fa8e8fcf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:27.702496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:27.703139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.703418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.703692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.704566 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1258/2550] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:27 2022] DELETE /identity/v3/users/e8195391d0b64e3a8396287fa61d4eb3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:27.705718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.708859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.709154 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.709438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.718078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:27.719609 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:27.727404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:27.728604 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.728897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1293/2551] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:27.789083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1259/2552] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:27.800090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:27.801781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:27.812822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56203a-5ea6-4edd-8ebf-4cea6d805028 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:27.861243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:27.861924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:27.862213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:27.862495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:27.872763 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:27.874335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c750e2-1c21-4c22-9ab3-727921de27b7 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:27.884705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1294/2553] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:28.096910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.103151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.119329 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201abe-0517-4607-b7e0-a92082aeccbd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.128839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.130450 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.130741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.131540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] PATH_INFO: `/v3/projects/5477d6af43c84c988b0597e0d77231fc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.140039 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5477d6af43c84c988b0597e0d77231fc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.142396 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.204384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5477d6af43c84c988b0597e0d77231fc', 'request_id': 'req-d582c9f3-7481-4fb4-9389-1b63efa4cd79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.210584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5477d6af43c84c988b0597e0d77231fc', 'request_id': 'req-d582c9f3-7481-4fb4-9389-1b63efa4cd79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.217858 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5477d6af43c84c988b0597e0d77231fc', 'request_id': 'req-d582c9f3-7481-4fb4-9389-1b63efa4cd79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.234776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] The token cache is being invalidate because project 5477d6af43c84c988b0597e0d77231fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:28.235176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.235979 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.237943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1260/2554] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:28 2022] DELETE /identity/v3/projects/5477d6af43c84c988b0597e0d77231fc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:28.242971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d70b-25aa-4883-918a-d597a30be77f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.243635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d70b-25aa-4883-918a-d597a30be77f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.244267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d70b-25aa-4883-918a-d597a30be77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.256906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.258365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.264947 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e1f7d70b-25aa-4883-918a-d597a30be77f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:28.267511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e1f7d70b-25aa-4883-918a-d597a30be77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.356423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1295/2555] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:28.358528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.358868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.359267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.367894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c9f3-7481-4fb4-9389-1b63efa4cd79 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.376256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.377354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.377971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.378422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] PATH_INFO: `/v3/projects/4f06341ab0a449e7ad74ee13cbb053cc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.379285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:28.379993 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f06341ab0a449e7ad74ee13cbb053cc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.380483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.382643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.393539 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1296/2556] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:28.394441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.404748 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e7c1-56cf-4ddd-969c-2e3fa6549b0c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.410922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.411900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.412669 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.413137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.414307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:28.414690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.417157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.443084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f06341ab0a449e7ad74ee13cbb053cc', 'request_id': 'req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.446067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1297/2557] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:28.449051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f06341ab0a449e7ad74ee13cbb053cc', 'request_id': 'req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.450573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.458513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f06341ab0a449e7ad74ee13cbb053cc', 'request_id': 'req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.464011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d06e3-ea16-443c-ae61-6e8267df2b6b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.478228 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] The token cache is being invalidate because project 4f06341ab0a449e7ad74ee13cbb053cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:28.478472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.479125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.480912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1261/2558] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:28 2022] DELETE /identity/v3/projects/4f06341ab0a449e7ad74ee13cbb053cc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:28.485880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.487626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.532915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.533745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.534100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.534455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.535365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.537345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.577391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1298/2559] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:28 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:28.578729 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.580499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.586983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca16e1-5c94-4ef9-9749-9e1f10afa4e8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.673407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8d03-36ac-4b2a-8604-3711a7dee481 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.674239 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.675484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.675901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.676246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] PATH_INFO: `/v3/users/bac0fc1af59540028239486113e1c75c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.679266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac0fc1af59540028239486113e1c75c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.681454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.695922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.696683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.697000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.697280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.698021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.703352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.735162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1299/2560] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:28 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:28.738645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.750594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e605e32-bf1f-46b5-91b4-79fab72edc7f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.757574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.758454 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.758970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.759401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.760341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.762553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.776131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1300/2561] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:28.780460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.790609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac0fc1af59540028239486113e1c75c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.796704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b849d1-4db9-4385-a66f-e83396d608f5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.811083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac0fc1af59540028239486113e1c75c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.811704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.812378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.812662 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.813052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.817876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.819560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac0fc1af59540028239486113e1c75c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.819698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.820435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac0fc1af59540028239486113e1c75c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.822097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19ce1ec3-b586-4d31-b9da-ffa692c2db2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac0fc1af59540028239486113e1c75c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:28.832267 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1301/2562] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:28.836289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:28.838226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:28.843227 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1262/2563] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:28 2022] DELETE /identity/v3/users/bac0fc1af59540028239486113e1c75c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:28.852815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258acb-c9f0-4103-9d2c-2daaee9520fe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:28.923868 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:28.925370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.925370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.925629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] PATH_INFO: `/v3/projects/888b28a6208c465288f0ef84b4301ddf/users/598c9e8691114cc3a740c8f6ce73a0a9/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.947890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888b28a6208c465288f0ef84b4301ddf, user_id=598c9e8691114cc3a740c8f6ce73a0a9, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:28.952772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:28.966040 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1302/2564] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:28 2022] PUT /identity/v3/projects/888b28a6208c465288f0ef84b4301ddf/users/598c9e8691114cc3a740c8f6ce73a0a9/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:28.971670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:28.971963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:28.972248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:28.991065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:28.992279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.053632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1263/2565] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:29.063310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.065008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.125676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9c4f-f78b-434e-bc5d-92ce072cdf89 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.131342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.131846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.132437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.132725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.132848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.133015 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.143148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.144611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fe86c-1af0-4648-9654-20b798980617 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.145711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556475b4-332e-4886-8746-f5a834ae1fa0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.151297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.152394 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.152853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.153375 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] PATH_INFO: `/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.155350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7fe838e8794a7bbc13a5e57f8b5ecd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.155925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1303/2566] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:29.157702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.208021 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7fe838e8794a7bbc13a5e57f8b5ecd', 'request_id': 'req-c23377bb-28c4-4c72-8258-cc2e64eefdcb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:29.213552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7fe838e8794a7bbc13a5e57f8b5ecd', 'request_id': 'req-c23377bb-28c4-4c72-8258-cc2e64eefdcb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:29.220730 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7fe838e8794a7bbc13a5e57f8b5ecd', 'request_id': 'req-c23377bb-28c4-4c72-8258-cc2e64eefdcb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:29.232880 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] The token cache is being invalidate because project 4d7fe838e8794a7bbc13a5e57f8b5ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:29.233415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:29.234579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c23377bb-28c4-4c72-8258-cc2e64eefdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:29.236174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1264/2567] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:29 2022] DELETE /identity/v3/projects/4d7fe838e8794a7bbc13a5e57f8b5ecd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:29.242458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.242812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.243215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.264808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:29.266455 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.334081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1304/2568] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:29.342087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.342380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.342663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.362977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:29.364202 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.372282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1265/2569] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:29.377246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.387776 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361371-946d-40ea-af7b-dd116e7204c4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.394150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.394838 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.395137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.395408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.396202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:29.396444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.398081 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.414845 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1305/2570] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:29.415939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.426863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8787ad-dc4a-4652-a1f2-595ad5b1bd56 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.431567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.432238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.432527 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.432808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.433612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.436283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.466727 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1266/2571] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:29.467962 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.478337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926b83-f263-4b56-bc30-a7916d30ffc0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.537318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.538166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.538453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.538730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.539436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.541532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.566394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1306/2572] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:29.567611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.578608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382e29-2ed7-4287-9d84-f6f1e37d795d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.584172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.584868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.585162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.585446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.586243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.587915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.602508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1267/2573] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:29.603980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.614781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a15f9-1059-4861-9f5d-0575ff58e44b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.619578 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.620259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.620549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.620834 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.621641 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.623850 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1721b7-7558-4ede-8ecc-b58c6be068ba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.636661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1307/2574] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:29.641206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.651508 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f91a-4c45-4cc8-9479-107e48ff72fb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.660904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.663193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.663781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.664341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] PATH_INFO: `/v3/projects/973d0c5c9c894307b9a03e02142f9e8b/users/46d907ad2a8f4f279e6a5697194c844b/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.684575 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=973d0c5c9c894307b9a03e02142f9e8b, user_id=46d907ad2a8f4f279e6a5697194c844b, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.688250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.702620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1268/2575] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:29 2022] PUT /identity/v3/projects/973d0c5c9c894307b9a03e02142f9e8b/users/46d907ad2a8f4f279e6a5697194c844b/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:29.713394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.713714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.713995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.740973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] MFA Rules not processed for user `46d907ad2a8f4f279e6a5697194c844b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:29.742198 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:29.816915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1308/2576] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:29.821352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.897677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f1d1-8150-46db-b968-f8174ab0b6cf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:29.910807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:29.911519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:29.911809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:29.912096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:29.912839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:29.914833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:29.945524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1269/2577] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:29.950328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:29.962359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c15b-44a6-4670-bd63-2c62b8925d78 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.029937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.030732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.031012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.031307 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.032141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.034279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bef79-63c2-4926-a3bb-9df94fab494d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.061408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1309/2578] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:29 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:30.064890 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.081377 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d9c7-ca5c-4158-958f-74bd3019a807 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.086177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.086859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.087150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.087435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.088172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.090643 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.091174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.097746 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.098185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.105655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1270/2579] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:30.110115 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.122259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c8af1-ed48-4450-9bcd-1d562cc534c0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.127322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.128022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.128309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.128869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.129635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.131551 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] MFA Rules not processed for user `598c9e8691114cc3a740c8f6ce73a0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:30.131848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.133224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:30.147998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1271/2580] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:30.149065 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.165322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281e1-7822-4a77-a92c-eed4795273d1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.170000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.171090 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.171380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.171824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] PATH_INFO: `/v3/projects/2adb640dab8f4059b5bd80c82e600798/users/f2596adc3cea48aaa141185a04f87e40/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.190633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adb640dab8f4059b5bd80c82e600798, user_id=f2596adc3cea48aaa141185a04f87e40, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.193610 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506025-ca7c-4b10-9546-16350688bf2b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.208422 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1272/2581] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:30 2022] PUT /identity/v3/projects/2adb640dab8f4059b5bd80c82e600798/users/f2596adc3cea48aaa141185a04f87e40/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:30.219688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.219968 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.220246 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.223726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1310/2582] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:30.228388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.229749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:30.242866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169805-56d0-4f7d-b7ed-9d0e85c664b3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.250220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] MFA Rules not processed for user `f2596adc3cea48aaa141185a04f87e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:30.251438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:30.302227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.302959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.303243 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.303623 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.304205 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.306331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.322694 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1273/2583] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:30.327129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.331719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1311/2584] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:30.335553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.339518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ddc03-4e79-4c5d-af0a-1bc6fd854075 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.395353 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6707-9de8-4aa5-a3e4-ee39a0f92855 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.395816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.396483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.396771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.397051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.397778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.399682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.400475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.401134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.401413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.401721 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.402400 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.404401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.424769 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1312/2585] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:30.424990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1274/2585] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:30.428637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.429760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.439561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc3a1a-c7a2-4472-912a-8809ad30b62f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.488603 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bc3b8-9e61-4cae-8503-2d8c2db2a1c9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.493249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.493940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.494160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.494338 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.494608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.494906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.495297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.495470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.495602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.496266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.496935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.498779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.507104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1275/2586] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:30.511374 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.518620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1313/2587] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:30.522472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.524254 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910738e0-dab6-4efe-a45f-41ab38b38f8b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.528805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.530453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.530672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.530946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] PATH_INFO: `/v3/projects/d07020b3267b476698df778e3480cd90/users/1ea7ea8d9a664551a7a5235b3b3d7a77/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.532495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683428f-e7bf-4297-b817-d1f743736029 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.537167 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.537849 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.538139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.538421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.539169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.541012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.545370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07020b3267b476698df778e3480cd90, user_id=1ea7ea8d9a664551a7a5235b3b3d7a77, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.548037 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.553911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1314/2588] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:30.555373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.564516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1276/2589] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:30 2022] PUT /identity/v3/projects/d07020b3267b476698df778e3480cd90/users/1ea7ea8d9a664551a7a5235b3b3d7a77/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:30.567054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397217b6-281e-4c50-b3e4-75d1c680f6a5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.568542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.623843 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.624725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.625011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.625289 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] PATH_INFO: `/v3/projects/2325defb8c584e50bfffa4774370542c/users/8fc05cbc7b994e9285453fe8e18b1d3c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.628685 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7465-6cd5-47db-8ab0-ed340f24f33e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.633827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.634357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.634650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.634924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.635645 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.637241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.641097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2325defb8c584e50bfffa4774370542c, user_id=8fc05cbc7b994e9285453fe8e18b1d3c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.643904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.648258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1277/2590] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:30.652553 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.657853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1315/2591] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:30 2022] PUT /identity/v3/projects/2325defb8c584e50bfffa4774370542c/users/8fc05cbc7b994e9285453fe8e18b1d3c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:30.661680 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.663627 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6efe8-11cb-4d36-92df-df50e808b822 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.721051 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.721972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.722259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.722541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] PATH_INFO: `/v3/projects/d07020b3267b476698df778e3480cd90/users/1ea7ea8d9a664551a7a5235b3b3d7a77/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.724523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07020b3267b476698df778e3480cd90, user_id=1ea7ea8d9a664551a7a5235b3b3d7a77, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.725292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0b006-e5ca-47c6-8958-809be436c613 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.727294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.729906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.730559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.730848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.731121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.731840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.733663 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14505533-dcf0-4d3a-bd0f-d44688e53d79 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.737586 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1278/2593] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:30 2022] PUT /identity/v3/projects/d07020b3267b476698df778e3480cd90/users/1ea7ea8d9a664551a7a5235b3b3d7a77/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:30.747302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1316/2594] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:30.749833 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.815769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d77c4f-cd9a-4e4e-b47b-ab5dd6ef67de admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:30.820533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:30.821419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.821749 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.822028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] PATH_INFO: `/v3/projects/2325defb8c584e50bfffa4774370542c/users/8fc05cbc7b994e9285453fe8e18b1d3c/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.824210 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2325defb8c584e50bfffa4774370542c, user_id=8fc05cbc7b994e9285453fe8e18b1d3c, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:30.827564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:30.838608 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1279/2595] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:30 2022] PUT /identity/v3/projects/2325defb8c584e50bfffa4774370542c/users/8fc05cbc7b994e9285453fe8e18b1d3c/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:30.850541 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:30.850831 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:30.851111 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:30.880115 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] MFA Rules not processed for user `8fc05cbc7b994e9285453fe8e18b1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:30.881328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:30.950903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1317/2596] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:30.962684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:30.964457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:31.024775 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c17c-aef8-4cdc-b81f-be6e73de5f62 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:31.028728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:31.029593 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:31.029884 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:31.030166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:31.039420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:31.040850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c433d-7993-4114-9292-9bba012ff595 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:31.052737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1280/2597] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:31.098320 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:31.099990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:31.114907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf810a3-bc0b-4830-8fd5-6795c1ffd7c8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:31.119035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:31.119766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:31.120168 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:31.120778 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:31.192383 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:31.193949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:31.202987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1318/2598] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:31.401700 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:31.402534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:31.402889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:31.437545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] MFA Rules not processed for user `1ea7ea8d9a664551a7a5235b3b3d7a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:31.438972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:31.520149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1281/2599] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:32.513722 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:32.574973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ea9a-27c4-4d8f-8c15-5f33aac9bbd3 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:32.579427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:32.580296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:32.580580 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:32.580858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] PATH_INFO: `/v3/users/598c9e8691114cc3a740c8f6ce73a0a9` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:32.582070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] RBAC: Authorizing `identity:delete_user(user_id=598c9e8691114cc3a740c8f6ce73a0a9)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:32.583988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:32.634042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598c9e8691114cc3a740c8f6ce73a0a9'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.645550 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598c9e8691114cc3a740c8f6ce73a0a9'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.646255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598c9e8691114cc3a740c8f6ce73a0a9'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.646852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598c9e8691114cc3a740c8f6ce73a0a9'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.654738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598c9e8691114cc3a740c8f6ce73a0a9'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.668594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1319/2600] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:32 2022] DELETE /identity/v3/users/598c9e8691114cc3a740c8f6ce73a0a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:32.834813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:32.846371 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295260f-a5fc-4190-81ae-569b44edd021 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:32.902837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:32.903702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:32.904571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:32.904854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] PATH_INFO: `/v3/projects/888b28a6208c465288f0ef84b4301ddf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:32.906058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=888b28a6208c465288f0ef84b4301ddf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:32.907964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:32.951723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888b28a6208c465288f0ef84b4301ddf', 'request_id': 'req-32b373b4-876c-472f-a281-06397199f5c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.956911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888b28a6208c465288f0ef84b4301ddf', 'request_id': 'req-32b373b4-876c-472f-a281-06397199f5c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.962855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888b28a6208c465288f0ef84b4301ddf', 'request_id': 'req-32b373b4-876c-472f-a281-06397199f5c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.975550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] The token cache is being invalidate because project 888b28a6208c465288f0ef84b4301ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:32.975843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.976465 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:32.978030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1282/2601] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:32 2022] DELETE /identity/v3/projects/888b28a6208c465288f0ef84b4301ddf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:32.982126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:32.984110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:32.997887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006467-284b-4cb8-8151-ea1df8c8912b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.054378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.055240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.055522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.055796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] PATH_INFO: `/v3/users/1ea7ea8d9a664551a7a5235b3b3d7a77` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.056959 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea7ea8d9a664551a7a5235b3b3d7a77)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.058894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.103736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea7ea8d9a664551a7a5235b3b3d7a77'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.115238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea7ea8d9a664551a7a5235b3b3d7a77'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.115902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea7ea8d9a664551a7a5235b3b3d7a77'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.116503 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea7ea8d9a664551a7a5235b3b3d7a77'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.123665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d27677c-f047-4638-90dc-3fa88dde11c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea7ea8d9a664551a7a5235b3b3d7a77'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.136160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1320/2602] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:32 2022] DELETE /identity/v3/users/1ea7ea8d9a664551a7a5235b3b3d7a77 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:33.307596 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.309047 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:33.322711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b373b4-876c-472f-a281-06397199f5c8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.381414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.382300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.382656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.382935 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] PATH_INFO: `/v3/projects/d07020b3267b476698df778e3480cd90` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.384111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07020b3267b476698df778e3480cd90)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.386054 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.437354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07020b3267b476698df778e3480cd90', 'request_id': 'req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.442555 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07020b3267b476698df778e3480cd90', 'request_id': 'req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.448346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07020b3267b476698df778e3480cd90', 'request_id': 'req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.461318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] The token cache is being invalidate because project d07020b3267b476698df778e3480cd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:33.461637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.462287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed0cfd05-e5ac-49c8-9511-cc273d82c6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:33.463752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1283/2603] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:33 2022] DELETE /identity/v3/projects/d07020b3267b476698df778e3480cd90 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:33.469375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.469707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.470025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.487379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:33.488577 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:33.546101 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1321/2604] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:33.554015 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.554305 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.554585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.572719 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:33.573944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:33.582354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1284/2605] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:33.586465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.596117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a004b-7188-4728-b175-92a8d4ac6bec None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.600631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.601272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.601592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.601869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.602592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:33.602896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.604476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.615942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1322/2606] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:33.619980 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.629726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d0baa-ac02-405b-8ea7-120ee57cec34 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.634474 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.635125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.635410 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.635686 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.636381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.638924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.668670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1285/2607] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:33.673510 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.683107 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b1c1e-6abc-4d91-aeed-50df3d337a0e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.738589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.739258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.739546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.739827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.740511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.742476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.762052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1323/2608] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:33.767098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.777302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509c36-16fc-415f-ba23-180420fa0885 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.782028 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.782681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.783035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.783323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.784064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.785731 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.795837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1286/2609] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:33.799612 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.809262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84017-59fe-4669-ab60-9047995b43e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.814426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.815073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.815359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.815646 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.816365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.817992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba7b46-4382-422d-a4be-dca57d39e777 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.828546 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1324/2610] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:33.832383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:33.842096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b60f9-4fab-4f4a-a61a-e0006d5bf66b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:33.846659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:33.847540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.847830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.848113 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] PATH_INFO: `/v3/projects/e9813e9c1a624eb9a3c4ea2108f159f2/users/2d904bd6c9ab436f9aa5fa39e35762ec/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.862901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9813e9c1a624eb9a3c4ea2108f159f2, user_id=2d904bd6c9ab436f9aa5fa39e35762ec, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:33.865623 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:33.879079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1287/2611] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:33 2022] PUT /identity/v3/projects/e9813e9c1a624eb9a3c4ea2108f159f2/users/2d904bd6c9ab436f9aa5fa39e35762ec/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:33.891242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:33.891531 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:33.891810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:33.917613 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] MFA Rules not processed for user `2d904bd6c9ab436f9aa5fa39e35762ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:33.918799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:33.980978 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1325/2612] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:33.986053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.047222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7bebf-502f-4162-90f3-342394e62013 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.052067 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.052726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.053011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.053292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.054030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.057153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.082525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1288/2613] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:33 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:34.086507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.097292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170fc65-b236-48a7-be15-8b8e8d4b3ed0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.152565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.153232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.153565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.153895 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.154618 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.156604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.176429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1326/2614] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:34 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:34.180502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.194076 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63734-7fd7-46b6-808d-10f85cf305e7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.198874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.199538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.199830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.200114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.201069 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.202715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.213005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1289/2615] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:34.217652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.227384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef322-8446-4fd8-95b8-3a42878c91eb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.232693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.233715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.234007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.234288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] PATH_INFO: `/v3/projects/f889186e58b8424dbbd8459956d2c362/users/379f058e5824433d8c0a2a7b64e02dd1/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.250201 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f889186e58b8424dbbd8459956d2c362, user_id=379f058e5824433d8c0a2a7b64e02dd1, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.252873 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.265152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1327/2616] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:34 2022] PUT /identity/v3/projects/f889186e58b8424dbbd8459956d2c362/users/379f058e5824433d8c0a2a7b64e02dd1/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:34.269272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.280026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21f0a-34a7-43cc-8755-ba0d8a18bff7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.334309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.334899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.335190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.335472 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.336190 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.337812 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6ed29-41c1-4191-a4a1-d7c8f2cbdfb9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.348004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1290/2617] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:34.352119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.362897 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3efb05-e909-4e8f-8500-86303f016e06 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.367617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.368491 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.368777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.369056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] PATH_INFO: `/v3/projects/f889186e58b8424dbbd8459956d2c362/users/379f058e5824433d8c0a2a7b64e02dd1/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.371035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f889186e58b8424dbbd8459956d2c362, user_id=379f058e5824433d8c0a2a7b64e02dd1, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.373692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.383462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1328/2618] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:34 2022] PUT /identity/v3/projects/f889186e58b8424dbbd8459956d2c362/users/379f058e5824433d8c0a2a7b64e02dd1/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:34.394297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.394612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.394895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.421660 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] MFA Rules not processed for user `379f058e5824433d8c0a2a7b64e02dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:34.422860 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:34.487832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1291/2619] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:34.498894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:34.500585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:34.556364 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061a64-7d35-4cc3-bc43-4e6475f59fcd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:34.560098 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:34.560931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:34.561215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:34.561517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:34.570237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:34.571670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44270-cb98-4da8-a943-5237a74976d4 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:34.581302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1329/2620] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:34.941370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:35.003204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7fcd-f929-473e-bc20-6d42bf02f4ec None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:35.007876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:35.008741 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:35.009024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:35.009300 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] PATH_INFO: `/v3/users/2d904bd6c9ab436f9aa5fa39e35762ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:35.010501 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d904bd6c9ab436f9aa5fa39e35762ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:35.012429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:35.056326 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d904bd6c9ab436f9aa5fa39e35762ec'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.069414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d904bd6c9ab436f9aa5fa39e35762ec'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.076809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d904bd6c9ab436f9aa5fa39e35762ec'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.077554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d904bd6c9ab436f9aa5fa39e35762ec'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.078176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d904bd6c9ab436f9aa5fa39e35762ec'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.090969 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1292/2621] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:34 2022] DELETE /identity/v3/users/2d904bd6c9ab436f9aa5fa39e35762ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:35.095385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:35.095679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:35.095986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:35.113759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:35.114940 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:35.171310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1330/2622] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:35.181085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:35.182624 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:35.237258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3a43-94fe-4507-a38f-c7039b398a11 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:35.240857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:35.241524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:35.241819 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:35.242095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:35.251287 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:35.252712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:35.262075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1293/2623] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:35.516861 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:35.518426 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:35.530700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d9fd8-d7e6-44a3-a56b-2a1a836bd035 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:35.535565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:35.536452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:35.536720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:35.537001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] PATH_INFO: `/v3/projects/e9813e9c1a624eb9a3c4ea2108f159f2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:35.538231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9813e9c1a624eb9a3c4ea2108f159f2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:35.540150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:35.586985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9813e9c1a624eb9a3c4ea2108f159f2', 'request_id': 'req-1c335b02-539a-497b-a94c-32d593ddcbe2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.592295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9813e9c1a624eb9a3c4ea2108f159f2', 'request_id': 'req-1c335b02-539a-497b-a94c-32d593ddcbe2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.599429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9813e9c1a624eb9a3c4ea2108f159f2', 'request_id': 'req-1c335b02-539a-497b-a94c-32d593ddcbe2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.610935 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] The token cache is being invalidate because project e9813e9c1a624eb9a3c4ea2108f159f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:35.611164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.611807 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.613368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1331/2624] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:35 2022] DELETE /identity/v3/projects/e9813e9c1a624eb9a3c4ea2108f159f2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:35.617266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:35.627272 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6b4f-823a-479d-854e-7287a04c04c3 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:35.682613 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:35.683486 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:35.683772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:35.684052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] PATH_INFO: `/v3/users/379f058e5824433d8c0a2a7b64e02dd1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:35.685274 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379f058e5824433d8c0a2a7b64e02dd1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:35.687349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:35.733811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379f058e5824433d8c0a2a7b64e02dd1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.744424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379f058e5824433d8c0a2a7b64e02dd1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.751561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379f058e5824433d8c0a2a7b64e02dd1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.752251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379f058e5824433d8c0a2a7b64e02dd1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.752870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31d9f26e-b890-4766-b608-881fe4411841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379f058e5824433d8c0a2a7b64e02dd1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:35.767011 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1294/2625] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:35 2022] DELETE /identity/v3/users/379f058e5824433d8c0a2a7b64e02dd1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:36.031695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.033122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.046890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335b02-539a-497b-a94c-32d593ddcbe2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.105255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.106164 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.106446 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.106724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] PATH_INFO: `/v3/projects/f889186e58b8424dbbd8459956d2c362` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.108473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f889186e58b8424dbbd8459956d2c362)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.110410 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.155338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f889186e58b8424dbbd8459956d2c362', 'request_id': 'req-6d693335-0fc5-4fd8-a525-103c1b0576d8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:36.160538 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f889186e58b8424dbbd8459956d2c362', 'request_id': 'req-6d693335-0fc5-4fd8-a525-103c1b0576d8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:36.167693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f889186e58b8424dbbd8459956d2c362', 'request_id': 'req-6d693335-0fc5-4fd8-a525-103c1b0576d8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:36.179527 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] The token cache is being invalidate because project f889186e58b8424dbbd8459956d2c362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:36.179826 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:36.180480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d693335-0fc5-4fd8-a525-103c1b0576d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:36.182395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1332/2626] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:36 2022] DELETE /identity/v3/projects/f889186e58b8424dbbd8459956d2c362 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:36.188116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.188537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.188705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.206767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:36.207972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.265524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1295/2627] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:36.273316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.273653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.273939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.291840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:36.293026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.301651 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1333/2628] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:36.306044 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.316972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cd78f-01a3-4c4d-a0c9-cbe1a0fe9286 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.321808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.322496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.322788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.323070 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.323836 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:36.324150 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.326445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.338532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1296/2629] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:36.343581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.352518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198ad3c-c233-4e2e-9eac-58268cc06209 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.357442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.358195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.358487 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.358762 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.359449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.361349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5480e4-413b-4dd4-9ab2-825703198740 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.388528 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1334/2630] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:36.392460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.402397 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41553d9-41d3-44c1-afbb-1649acb0a4c3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.478751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.479070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.479337 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.482491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.483382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.483732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.484135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.484767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.487005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.498950 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:36.500325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.509621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1297/2631] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:36.514737 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.526901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8639-cf26-4550-931b-aef9a0cf1a5d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.532235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.533018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.533405 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.533813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.535279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.536998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.548767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1298/2632] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:36.552757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.559187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1335/2633] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:36.565077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c1b-cd02-45f5-b12f-e0e308c1e98a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.571905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.572577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.572862 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.573140 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.574186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.586580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.591729 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1299/2634] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:36.593277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.607790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17687c-f0d1-4b11-9894-6b72fcb54f81 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.612484 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.613668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.614373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.614984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.615438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.615856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] PATH_INFO: `/v3/projects/3621e2a68403402abebd5f139d202fed/users/277b8de86c1d4575bf2112ede7d3f148/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.636394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3621e2a68403402abebd5f139d202fed, user_id=277b8de86c1d4575bf2112ede7d3f148, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.641389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed8e65-de26-44fc-8e1b-189f91fb7dba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.656851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1336/2635] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:36 2022] PUT /identity/v3/projects/3621e2a68403402abebd5f139d202fed/users/277b8de86c1d4575bf2112ede7d3f148/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:36.667999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.668282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.668564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.692334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325e75b-1cbd-42e1-a16f-4812d5128bad admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.695429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] MFA Rules not processed for user `277b8de86c1d4575bf2112ede7d3f148`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:36.697232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:36.767684 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.768435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.768793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.769083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.772803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1337/2636] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:36.773988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.834463 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.836166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.842366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70abac2-34c9-4a62-a32e-c0437c807052 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.845701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1300/2637] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:06:36.851735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.852457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.852745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.859151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.859151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.859151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:36.886430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1338/2638] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:36.891502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:36.907399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0144b0-405c-4dee-8b75-06c57ef7b01d service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:36.972800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:36.973665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:36.973912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:36.974230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:36.974916 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:36.977012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.009605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1301/2639] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:36 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:37.019374 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:37.031152 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8bbe3-8e7e-4d9c-a093-df09eff5fe4f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:37.047600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:37.048268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.048724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.049165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.050084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:37.051862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.093484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1339/2640] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:37.116455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:37.161173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284edfc4-df93-42ed-8d61-1aeb1c457057 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:37.183599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:37.191545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.195116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.195883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] PATH_INFO: `/v3/projects/5a7e55de316740c6aa7bc46acba24d5c/users/bc7ae0ed87a94ac2be972ae1cfab1410/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.226942 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7e55de316740c6aa7bc46acba24d5c, user_id=bc7ae0ed87a94ac2be972ae1cfab1410, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:37.230001 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.256520 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1302/2641] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:37 2022] PUT /identity/v3/projects/5a7e55de316740c6aa7bc46acba24d5c/users/bc7ae0ed87a94ac2be972ae1cfab1410/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:37.266288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:37.277855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937cae-4303-4f0b-b57a-9cfb654d4b59 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:37.361656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:37.362499 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.363079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.363591 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.364813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:37.366702 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57511a57-f02b-4246-81fe-b1373399be06 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.379341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1340/2642] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:37.383840 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:37.399079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501f3a-6c21-426c-a202-a0cb1b00f6a9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:37.412057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:37.414007 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.428151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.429096 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] PATH_INFO: `/v3/projects/5a7e55de316740c6aa7bc46acba24d5c/users/bc7ae0ed87a94ac2be972ae1cfab1410/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.447498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7e55de316740c6aa7bc46acba24d5c, user_id=bc7ae0ed87a94ac2be972ae1cfab1410, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:37.447498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.469970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1303/2643] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:37 2022] PUT /identity/v3/projects/5a7e55de316740c6aa7bc46acba24d5c/users/bc7ae0ed87a94ac2be972ae1cfab1410/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:37.479892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.480286 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.480725 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.510581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] MFA Rules not processed for user `bc7ae0ed87a94ac2be972ae1cfab1410`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:37.512211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:37.601908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1341/2644] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:37.615930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:37.617861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:37.691582 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46712ac-6422-4428-8391-e1d31596a750 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:37.695882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:37.696614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:37.697036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:37.697418 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:37.708258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:37.710490 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:37.723793 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1304/2645] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:38.230689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:38.240708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06a619-956a-4a71-9cd3-2ba7bc839afb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:38.245889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7ae0ed87a94ac2be972ae1cfab1410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a7e55de316740c6aa7bc46acba24d5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:38.246632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.247011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.248202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:38.249656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:38.249980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:38.251720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:38.264411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1342/2646] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:38.268955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:38.278233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c941e-4183-405a-b946-7da9d6b1fd2c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:38.284445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7ae0ed87a94ac2be972ae1cfab1410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a7e55de316740c6aa7bc46acba24d5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:38.285349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.285705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.286101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:38.287046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:38.289270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:38.317521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1305/2647] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:38 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:38.320986 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:38.334190 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493138b-199f-49e0-a2e8-dcdbc0055b4d tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:38.400041 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7ae0ed87a94ac2be972ae1cfab1410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a7e55de316740c6aa7bc46acba24d5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:38.401549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.402171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.402692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:38.403812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:38.404367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:38.406318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:38.421238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1343/2648] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:06:38.501151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:38.514147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5756-f9ab-43da-8549-97b774442cd9 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:38.552362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7ae0ed87a94ac2be972ae1cfab1410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a7e55de316740c6aa7bc46acba24d5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:38.553259 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.553583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.553869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] PATH_INFO: `/v3/projects/ce4549d9ea0e4369b95c94045a5c0f6f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:38.557982 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce4549d9ea0e4369b95c94045a5c0f6f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:38.560847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:38.652707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4549d9ea0e4369b95c94045a5c0f6f', 'request_id': 'req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.659438 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4549d9ea0e4369b95c94045a5c0f6f', 'request_id': 'req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.665957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4549d9ea0e4369b95c94045a5c0f6f', 'request_id': 'req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.690391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:38.691068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] The token cache is being invalidate because project ce4549d9ea0e4369b95c94045a5c0f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:38.691380 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.692383 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f02c1edf-7f42-47a3-87ac-d9b4991cf42c tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.694098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1306/2649] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:38 2022] DELETE /identity/v3/projects/ce4549d9ea0e4369b95c94045a5c0f6f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:38.697839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:38.776312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee02fa4-44d1-496d-b0da-6d8dd01e7c18 tempest-VolumeQuotaClassesTest-2128895608 tempest-VolumeQuotaClassesTest-2128895608-project-admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:38.875033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:38.876575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.877087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.877633 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] PATH_INFO: `/v3/users/46d907ad2a8f4f279e6a5697194c844b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:38.879277 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d907ad2a8f4f279e6a5697194c844b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:38.881987 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:38.942394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d907ad2a8f4f279e6a5697194c844b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.956035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d907ad2a8f4f279e6a5697194c844b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.957100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d907ad2a8f4f279e6a5697194c844b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.958661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d907ad2a8f4f279e6a5697194c844b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.968629 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d907ad2a8f4f279e6a5697194c844b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:38.985810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1344/2650] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:38 2022] DELETE /identity/v3/users/46d907ad2a8f4f279e6a5697194c844b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:38.993388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:38.993808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:38.994161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.010335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:39.012285 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.029126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:39.031679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.126885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1307/2651] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:39.128635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9b8b-fe3c-476d-a28b-19196ca84dd6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:39.132677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:39.134804 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.134969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:39.136073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.136601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.136990 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] PATH_INFO: `/v3/users/277b8de86c1d4575bf2112ede7d3f148` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.139436 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=277b8de86c1d4575bf2112ede7d3f148)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:39.142944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:39.254233 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277b8de86c1d4575bf2112ede7d3f148'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.258965 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498602c-f814-4243-81a1-436f42f77f96 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:39.270946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:39.271597 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277b8de86c1d4575bf2112ede7d3f148'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.272023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277b8de86c1d4575bf2112ede7d3f148'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.272759 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277b8de86c1d4575bf2112ede7d3f148'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.273720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.276605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.277373 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.282798 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.286074 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ef9f27d-f547-41a5-b949-d2997966d84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277b8de86c1d4575bf2112ede7d3f148'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.308784 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:39.310564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:39.316741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1345/2652] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:39 2022] DELETE /identity/v3/users/277b8de86c1d4575bf2112ede7d3f148 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:39.326635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.327013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.327235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.330946 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1308/2653] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:39.349730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:39.350973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.482350 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1346/2654] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:39.494988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:39.496541 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.520138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5c702-84e2-4964-a533-0d4dc9f5dd79 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:39.586952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:39.587635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.587951 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.588237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.599743 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:39.601519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378516db-439f-4f0e-a126-c6da6b890207 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:39.612605 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1309/2655] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:39.665928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:39.668261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.707631 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bd01f-fc77-410f-862a-479ec3be5396 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:39.715583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:39.718827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.719239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.719681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] PATH_INFO: `/v3/users/33071d44ad5b49c5897f3d1f2f5816d4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.721292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33071d44ad5b49c5897f3d1f2f5816d4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:39.724711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:39.798125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33071d44ad5b49c5897f3d1f2f5816d4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.814235 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33071d44ad5b49c5897f3d1f2f5816d4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.815440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33071d44ad5b49c5897f3d1f2f5816d4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.816151 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33071d44ad5b49c5897f3d1f2f5816d4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.826306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33071d44ad5b49c5897f3d1f2f5816d4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:39.845586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1347/2656] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:39 2022] DELETE /identity/v3/users/33071d44ad5b49c5897f3d1f2f5816d4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:39.847837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.848249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.851177 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.860846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:39.864272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.883060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:39.886767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:39.984711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b243-8d17-4d99-9642-8eaa936ea4a6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:39.989984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:39.991093 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:39.991564 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:39.992009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] PATH_INFO: `/v3/projects/973d0c5c9c894307b9a03e02142f9e8b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:39.993439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973d0c5c9c894307b9a03e02142f9e8b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:39.995822 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:40.003918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1310/2657] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:40.020369 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:40.022956 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.082302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973d0c5c9c894307b9a03e02142f9e8b', 'request_id': 'req-6622ad08-e653-4a92-8af9-795de0154c15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.091698 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973d0c5c9c894307b9a03e02142f9e8b', 'request_id': 'req-6622ad08-e653-4a92-8af9-795de0154c15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.110136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973d0c5c9c894307b9a03e02142f9e8b', 'request_id': 'req-6622ad08-e653-4a92-8af9-795de0154c15'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.119318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b136-4f7f-41c2-8b76-a490e38e90f6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:40.126507 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] The token cache is being invalidate because project 973d0c5c9c894307b9a03e02142f9e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:40.126804 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.127476 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.129330 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1348/2658] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:39 2022] DELETE /identity/v3/projects/973d0c5c9c894307b9a03e02142f9e8b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:40.130171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:40.131475 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.191286 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:40.192236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:40.192992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:40.193519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:40.195564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.244783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ad08-e653-4a92-8af9-795de0154c15 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:40.251372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:40.252558 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:40.252999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:40.253430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] PATH_INFO: `/v3/projects/3621e2a68403402abebd5f139d202fed` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:40.256566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3621e2a68403402abebd5f139d202fed)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:40.258915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:40.283425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:40.285328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:40.296617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1311/2659] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:40.297791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:40.299915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.315204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9c13-857a-4290-8a8b-c386e89915cd service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:40.327150 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3621e2a68403402abebd5f139d202fed', 'request_id': 'req-ff8018f5-9c40-41e0-95b5-918be9f60329'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.334474 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3621e2a68403402abebd5f139d202fed', 'request_id': 'req-ff8018f5-9c40-41e0-95b5-918be9f60329'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.345525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3621e2a68403402abebd5f139d202fed', 'request_id': 'req-ff8018f5-9c40-41e0-95b5-918be9f60329'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.403506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] The token cache is being invalidate because project 3621e2a68403402abebd5f139d202fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:40.404321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.405853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.410856 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1349/2660] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:40 2022] DELETE /identity/v3/projects/3621e2a68403402abebd5f139d202fed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:40.412073 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:40.413953 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.415820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:40.416714 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:40.417000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:40.417281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] PATH_INFO: `/v3/users/f2596adc3cea48aaa141185a04f87e40` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:40.422364 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2596adc3cea48aaa141185a04f87e40)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:40.424428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:40.429288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8018f5-9c40-41e0-95b5-918be9f60329 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:40.444851 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:40.446305 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:40.447126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:40.447126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] PATH_INFO: `/v3/users/bc7ae0ed87a94ac2be972ae1cfab1410` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:40.448262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7ae0ed87a94ac2be972ae1cfab1410)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:40.451232 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:40.500838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2596adc3cea48aaa141185a04f87e40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.513887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2596adc3cea48aaa141185a04f87e40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.526699 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2596adc3cea48aaa141185a04f87e40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.527848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2596adc3cea48aaa141185a04f87e40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.529308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2596adc3cea48aaa141185a04f87e40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.553772 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1312/2661] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:40 2022] DELETE /identity/v3/users/f2596adc3cea48aaa141185a04f87e40 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:40.597933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7ae0ed87a94ac2be972ae1cfab1410'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.611682 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7ae0ed87a94ac2be972ae1cfab1410'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.613351 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7ae0ed87a94ac2be972ae1cfab1410'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.614294 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7ae0ed87a94ac2be972ae1cfab1410'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.627009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7ae0ed87a94ac2be972ae1cfab1410'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:40.646879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1350/2662] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:40 2022] DELETE /identity/v3/users/bc7ae0ed87a94ac2be972ae1cfab1410 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:40.802771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:40.805387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:40.898573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b0c05-c0a2-4ef2-804a-74b57ea91daa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:40.963870 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:40.965425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:40.965821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:40.966253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] PATH_INFO: `/v3/projects/411b53e128de4f1dac958385716f7553` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:40.969423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411b53e128de4f1dac958385716f7553)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:40.971750 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.032997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.034492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.038135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411b53e128de4f1dac958385716f7553', 'request_id': 'req-8c9870ee-2199-4f82-b59b-23cbea22f433'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.045940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411b53e128de4f1dac958385716f7553', 'request_id': 'req-8c9870ee-2199-4f82-b59b-23cbea22f433'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.054974 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411b53e128de4f1dac958385716f7553', 'request_id': 'req-8c9870ee-2199-4f82-b59b-23cbea22f433'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.057023 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929fdc-b668-40e0-a532-d8aa20d5fd59 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.075192 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] The token cache is being invalidate because project 411b53e128de4f1dac958385716f7553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:41.075924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.077257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.080832 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1313/2663] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:40 2022] DELETE /identity/v3/projects/411b53e128de4f1dac958385716f7553 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:41.084704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.086249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.162668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9870ee-2199-4f82-b59b-23cbea22f433 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.167748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.168691 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.168984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.169913 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] PATH_INFO: `/v3/users/11902abbf85b444c8a1003b2b22b122f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.171751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11902abbf85b444c8a1003b2b22b122f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.173769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.181689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.182735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.183119 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.183494 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] PATH_INFO: `/v3/projects/2adb640dab8f4059b5bd80c82e600798` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.185445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adb640dab8f4059b5bd80c82e600798)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.189715 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.238752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11902abbf85b444c8a1003b2b22b122f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.267165 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11902abbf85b444c8a1003b2b22b122f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.282097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11902abbf85b444c8a1003b2b22b122f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.286378 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11902abbf85b444c8a1003b2b22b122f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.287388 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11902abbf85b444c8a1003b2b22b122f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.295859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adb640dab8f4059b5bd80c82e600798', 'request_id': 'req-2061bccf-1514-46f6-b789-0c3de31c4635'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.302369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adb640dab8f4059b5bd80c82e600798', 'request_id': 'req-2061bccf-1514-46f6-b789-0c3de31c4635'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.310328 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1314/2664] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:41 2022] DELETE /identity/v3/users/11902abbf85b444c8a1003b2b22b122f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:41.312167 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.313992 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.323952 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adb640dab8f4059b5bd80c82e600798', 'request_id': 'req-2061bccf-1514-46f6-b789-0c3de31c4635'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.356929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] The token cache is being invalidate because project 2adb640dab8f4059b5bd80c82e600798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:41.357266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.357932 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.364963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1351/2665] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:41 2022] DELETE /identity/v3/projects/2adb640dab8f4059b5bd80c82e600798 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:41.367059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.371096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.405618 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391f371-b361-45db-b86c-04f332a6c72e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.422452 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.424534 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.425751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.426191 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] PATH_INFO: `/v3/projects/5a7e55de316740c6aa7bc46acba24d5c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.430478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7e55de316740c6aa7bc46acba24d5c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.437427 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.476144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bccf-1514-46f6-b789-0c3de31c4635 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.483480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.484860 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.485380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.485815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] PATH_INFO: `/v3/users/8fc05cbc7b994e9285453fe8e18b1d3c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.487376 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc05cbc7b994e9285453fe8e18b1d3c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.489601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.543362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7e55de316740c6aa7bc46acba24d5c', 'request_id': 'req-e0299f02-9066-4009-b759-f524270f4ad1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.557901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7e55de316740c6aa7bc46acba24d5c', 'request_id': 'req-e0299f02-9066-4009-b759-f524270f4ad1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.566396 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc05cbc7b994e9285453fe8e18b1d3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.569585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7e55de316740c6aa7bc46acba24d5c', 'request_id': 'req-e0299f02-9066-4009-b759-f524270f4ad1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.588031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc05cbc7b994e9285453fe8e18b1d3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.588550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] The token cache is being invalidate because project 5a7e55de316740c6aa7bc46acba24d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:41.589004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.589389 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc05cbc7b994e9285453fe8e18b1d3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.589706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0299f02-9066-4009-b759-f524270f4ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.590393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc05cbc7b994e9285453fe8e18b1d3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.592143 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1315/2666] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:41 2022] DELETE /identity/v3/projects/5a7e55de316740c6aa7bc46acba24d5c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:41.597614 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b274d0-7cfd-4e0d-ba95-d1b5091ff734 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.598063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b274d0-7cfd-4e0d-ba95-d1b5091ff734 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.598607 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b274d0-7cfd-4e0d-ba95-d1b5091ff734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.610404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc05cbc7b994e9285453fe8e18b1d3c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.620963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d0b274d0-7cfd-4e0d-ba95-d1b5091ff734 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:41.622551 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d0b274d0-7cfd-4e0d-ba95-d1b5091ff734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.635904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1352/2667] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:41 2022] DELETE /identity/v3/users/8fc05cbc7b994e9285453fe8e18b1d3c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:41.711683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.714461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.737998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1316/2668] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:41.747052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.747646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.748041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.772066 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:41.773874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:41.848359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973de64-3df4-4060-a227-a955ec24086c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.864513 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1317/2669] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:41.865830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.876792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf6674-3d29-45ed-bf98-fae85ba81f65 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.881966 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.885536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.885536 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.885919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.886157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.886157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:41.886157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.886404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.886404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.886404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] PATH_INFO: `/v3/projects/0c07382b75b546679da282acd2c6b0d6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.887135 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.887434 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c07382b75b546679da282acd2c6b0d6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.889901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.906073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1318/2670] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:41.908260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.927900 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578cfd7-8e50-4ecb-b274-f210cdf880a7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:41.940273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:41.940947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:41.941229 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:41.941525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:41.942279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:41.944196 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:41.985554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c07382b75b546679da282acd2c6b0d6', 'request_id': 'req-ef265744-093e-429b-bcda-0935a4344e26'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:41.986068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1319/2671] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:41 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:41.986973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:41.995097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c07382b75b546679da282acd2c6b0d6', 'request_id': 'req-ef265744-093e-429b-bcda-0935a4344e26'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.012045 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c07382b75b546679da282acd2c6b0d6', 'request_id': 'req-ef265744-093e-429b-bcda-0935a4344e26'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.031075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] The token cache is being invalidate because project 0c07382b75b546679da282acd2c6b0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:42.031699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.032535 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ef265744-093e-429b-bcda-0935a4344e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.034707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1353/2672] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:41 2022] DELETE /identity/v3/projects/0c07382b75b546679da282acd2c6b0d6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:42.041043 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.044067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.045345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.078165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:42.079839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.104323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e0f43-2b8d-4479-92b1-89299e77b820 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.110481 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.111667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.112117 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.112620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.113526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.115828 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.155411 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1320/2673] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:41 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:42.158800 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.160930 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.177428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368c51-ad68-4a1a-a5a9-3956ef4e3e92 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.183243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.184323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.184910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.185349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] PATH_INFO: `/v3/projects/2325defb8c584e50bfffa4774370542c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.187245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2325defb8c584e50bfffa4774370542c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.189560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.195281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1354/2674] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:42.196349 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.198328 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.213893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4966f1-98e6-4c0a-a246-bf755afad70a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.220443 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.221247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.221677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.224037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.224037 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.224674 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b791c6a-9ff9-4bf0-90e3-88891393512d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.237370 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1355/2675] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:42.238923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fc9a-8b2e-4a6a-86da-d2b28ae2241e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.239335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fc9a-8b2e-4a6a-86da-d2b28ae2241e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.239716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fc9a-8b2e-4a6a-86da-d2b28ae2241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.267453 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d51fc9a-8b2e-4a6a-86da-d2b28ae2241e None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:42.270888 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d51fc9a-8b2e-4a6a-86da-d2b28ae2241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.286324 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2325defb8c584e50bfffa4774370542c', 'request_id': 'req-e0cc5940-ff4a-4ed6-a211-5115c988e427'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.295808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2325defb8c584e50bfffa4774370542c', 'request_id': 'req-e0cc5940-ff4a-4ed6-a211-5115c988e427'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.319682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2325defb8c584e50bfffa4774370542c', 'request_id': 'req-e0cc5940-ff4a-4ed6-a211-5115c988e427'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.343308 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] The token cache is being invalidate because project 2325defb8c584e50bfffa4774370542c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:42.344144 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.345342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:42.348528 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1321/2676] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:42 2022] DELETE /identity/v3/projects/2325defb8c584e50bfffa4774370542c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:42.349809 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.351537 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.395900 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1356/2677] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:42.397244 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.397553 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.398009 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.423677 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:42.424885 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.437386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1357/2678] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:42.438288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.452486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808774e-72bd-49cb-b8ef-ceca248d5f4f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.457645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.458325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.458611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.458894 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.459635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:42.459943 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.461718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7973-aa6d-48a4-967a-947a2f77790f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.473010 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc5940-ff4a-4ed6-a211-5115c988e427 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.476026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1358/2679] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:42.476985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.477279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.477594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.484887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.485811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.487138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.487138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.487395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.489105 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.497678 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:42.499157 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.501247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1322/2680] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:42.502201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.515827 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25799-855a-40a0-9c34-6b0e91071b01 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.518853 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1359/2681] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:42.519726 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.524844 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.525665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.526182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.526425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.527220 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.530156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.532652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34f16a-56b2-4f32-8fb0-96c25fbcca59 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.540067 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.540984 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.541272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.541583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] PATH_INFO: `/v3/projects/8582e121f5364a8182e98933641b58af/users/ed8d9ac660614df6a99a029d23aca057/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.563339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8582e121f5364a8182e98933641b58af, user_id=ed8d9ac660614df6a99a029d23aca057, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.566202 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.568049 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1323/2682] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:42.570512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.584839 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1360/2683] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:42 2022] PUT /identity/v3/projects/8582e121f5364a8182e98933641b58af/users/ed8d9ac660614df6a99a029d23aca057/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:42.585706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.667921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf1b90-6987-442e-8ced-e7f14b1c68b6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.673109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745c0b5-c410-409d-b602-e0cb8d15b78c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.673414 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.674112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.674395 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.674671 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.675611 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.678599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.681705 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.682724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.683231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.683722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.684851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:06:42.685668 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.687751 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3939f-e2e5-4280-ae85-b6003a1786b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.704640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1324/2684] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:06:42.708272 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1361/2685] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/users => generated 278 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:42.708709 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.709857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.710314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.710756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.719766 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f772-0a1c-47ea-bc94-838c5efcd749 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.726393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.727071 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.727355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.727632 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.728325 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.730279 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.733745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:42.735316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.744745 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1325/2686] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:42.745991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.759043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053214bc-62e9-4692-9759-7477a0baaa29 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.763072 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1362/2687] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:42.764369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.766316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:42.767466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.768500 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.768944 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.769414 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.770507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.773095 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.790621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1326/2688] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:42.791617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.805429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46165-b21d-424a-9873-26fe43a2e817 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.854425 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089de-d6a7-4a14-87f5-e78f6b731987 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.864106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.864862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.865154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.865438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.889831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.889831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.889831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.889831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.890788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.893055 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.925507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1327/2689] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:42 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:42.926262 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.937984 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc24fd-b594-4e78-9a25-4f939ee20363 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.944297 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.944976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.945268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.945585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.946322 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.947921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.953747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.955249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.960567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1328/2690] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:42.962299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.969615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1363/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:42.970268 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:42.975482 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774467f8-d7e2-4559-a9a2-0f410c98d8d6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.980170 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc59e8-732a-48ff-a398-c8febae7bbcc service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:42.985748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.986595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.986889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.987173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:42.987918 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:42.989585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:42.993626 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:42.994637 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:42.995021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:42.995749 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] PATH_INFO: `/v3/projects/6a02a3c80bf34e71a63f8da7c1681493/users/4eefd77986c3435385a9f839e7b4fee1/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.014654 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1329/2692] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:43.015848 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.024689 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a02a3c80bf34e71a63f8da7c1681493, user_id=4eefd77986c3435385a9f839e7b4fee1, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.027526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a7db-4e61-4b2d-b16b-5224bc10e7fd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.033529 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.034399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.034796 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.035161 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.035297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0677-539b-41f5-839c-69376c939f27 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.036132 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.038155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.052483 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1330/2693] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:43.058182 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1364/2694] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:42 2022] PUT /identity/v3/projects/6a02a3c80bf34e71a63f8da7c1681493/users/4eefd77986c3435385a9f839e7b4fee1/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:43.059385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.069271 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.069679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.070401 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.081296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7378d-f99f-4e41-8f36-cfe95f804994 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.105656 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] MFA Rules not processed for user `4eefd77986c3435385a9f839e7b4fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:43.110855 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:43.201637 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.202859 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.203092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.203270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] PATH_INFO: `/v3/projects/08c122c7f24b441db51a296b8855458b/users/c67768c35ada4f4b88634c86f81c0c77/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.222816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c122c7f24b441db51a296b8855458b, user_id=c67768c35ada4f4b88634c86f81c0c77, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.225855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada1a6f-0d54-42b4-93ad-3a017867b0e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.235929 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1365/2695] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:06:43.240653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.254413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1331/2696] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:43 2022] PUT /identity/v3/projects/08c122c7f24b441db51a296b8855458b/users/c67768c35ada4f4b88634c86f81c0c77/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:43.257312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb5dfd-4d4a-49b3-84ae-664b0597120e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.276215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.277757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.278882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.334712 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] MFA Rules not processed for user `c67768c35ada4f4b88634c86f81c0c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:43.336147 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:43.366200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.367308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.367981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.368992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.370016 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.372988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.448070 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1366/2697] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/projects => generated 355 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:43.454655 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.478339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1332/2698] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:43.484174 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.500350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42250-9992-41c9-b95b-d9ccc87c5653 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.593141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca64f-ea05-4f29-a8ed-770d9fbf4b43 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.604483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.606486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.608003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.608824 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.610840 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.612907 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.614929 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.615652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.616885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.617268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.618708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.626682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.649874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1367/2699] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:06:43.656818 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.674857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e27-6c03-4dbd-92fd-d774766d10f5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.680354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1333/2700] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:43.682113 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.682977 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.683399 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.683884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.684439 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.686125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.688515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.715517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1368/2701] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:43.720137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.737035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613b3b-6d12-42d9-944d-14c142473af5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.783018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294822f1-3ae4-41c0-a254-8fa77f0108d4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.792331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.793323 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.793780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.794187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.795990 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.799782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.805988 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.807951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.808813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.809432 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] PATH_INFO: `/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd/users/55de0e203ac54f85a7f663ed7ca4274f/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.836121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1334/2702] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:43 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:43.838490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc8538a0e4d464fb3fefd6d67ef31fd, user_id=55de0e203ac54f85a7f663ed7ca4274f, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.840032 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.842408 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.857519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954ec7-2c3a-4ed2-806c-f288377f8527 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.867975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1369/2703] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:43 2022] PUT /identity/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd/users/55de0e203ac54f85a7f663ed7ca4274f/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:43.872216 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.929933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.930887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.931184 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.931466 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:43.932354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:43.934510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:43.947050 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1335/2704] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:43.952782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:43.968278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6fd98-e7f7-4232-96b8-6707c2aedef9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:43.975609 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:43.976635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:43.977116 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:43.977505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] PATH_INFO: `/v3/projects/f738263a60234d25a6f1daaf0e2e1982/users/f38aa13aa093480681067e719d7cc2c3/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.000989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f738263a60234d25a6f1daaf0e2e1982, user_id=f38aa13aa093480681067e719d7cc2c3, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.002796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5b12-4b9c-4152-8366-27f81f8f97a1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.004748 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.012679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.014315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.015240 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.016508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.017390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.019960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c72a5-3b53-48d5-af33-49b5c98b6251 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.034672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1370/2705] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:06:44.034672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136a08-7331-4feb-bdde-86ff16be5b82 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.034672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136a08-7331-4feb-bdde-86ff16be5b82 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.034672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136a08-7331-4feb-bdde-86ff16be5b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.038278 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1336/2706] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:43 2022] PUT /identity/v3/projects/f738263a60234d25a6f1daaf0e2e1982/users/f38aa13aa093480681067e719d7cc2c3/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:44.039462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.070504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-51136a08-7331-4feb-bdde-86ff16be5b82 None None] MFA Rules not processed for user `ed8d9ac660614df6a99a029d23aca057`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:44.071783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-51136a08-7331-4feb-bdde-86ff16be5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:44.144119 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7445-c5b4-4f06-8235-c6e7ec4cddce admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.150456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.151365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.151646 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.154155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] PATH_INFO: `/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd/users/55de0e203ac54f85a7f663ed7ca4274f/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.156681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc8538a0e4d464fb3fefd6d67ef31fd, user_id=55de0e203ac54f85a7f663ed7ca4274f, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.159970 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.172248 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1337/2707] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:44 2022] PUT /identity/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd/users/55de0e203ac54f85a7f663ed7ca4274f/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:44.177794 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.201143 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1371/2708] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:44.203980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.204418 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.205302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.246957 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] MFA Rules not processed for user `55de0e203ac54f85a7f663ed7ca4274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:44.249705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:44.289012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb72f-9a45-451e-929c-fbc0e945bc17 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.294059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.294777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.295068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.295351 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.296084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.297716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.312149 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1338/2709] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:44.313091 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.323131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779fba-a1c2-46fe-8961-154f2a47b6c6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.329507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.330295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.330565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.330850 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.331558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.333550 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.362601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1372/2710] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:44.363758 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.378044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432cf8-f740-46a8-bb1a-2fcb95e6eacd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.378439 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1339/2711] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:06:44 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:44.379293 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.383891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:44.452667 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc583-339f-4b1e-aed9-88994ee238d5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.460518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.461187 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.461499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.461787 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.478779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.478779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.478779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.478779 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] PATH_INFO: `/v3/projects/f738263a60234d25a6f1daaf0e2e1982/users/f38aa13aa093480681067e719d7cc2c3/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.480707 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f738263a60234d25a6f1daaf0e2e1982, user_id=f38aa13aa093480681067e719d7cc2c3, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.484939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.510600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1373/2712] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:44 2022] PUT /identity/v3/projects/f738263a60234d25a6f1daaf0e2e1982/users/f38aa13aa093480681067e719d7cc2c3/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:44.511592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.569792 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.573767 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97198dbd-a29e-4d3f-88d5-d222a30b1f4d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.583082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1340/2713] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:44.585320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.585723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.586580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.632924 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] MFA Rules not processed for user `f38aa13aa093480681067e719d7cc2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:44.634552 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:44.646061 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bcb69-99ee-4377-8d4d-a0d6d867a41e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.654005 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.654960 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.655313 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.655620 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.659576 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.668973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.743466 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1374/2714] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:06:44 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:06:44.744294 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1341/2715] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:44.746916 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.750835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.759397 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259c589-0e4f-4cae-8bf5-f3be62f3ae4e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.765649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85404-6127-4093-9003-119a6090345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.766384 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85404-6127-4093-9003-119a6090345b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.766773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85404-6127-4093-9003-119a6090345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.767188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85404-6127-4093-9003-119a6090345b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.768000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85404-6127-4093-9003-119a6090345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.769887 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85404-6127-4093-9003-119a6090345b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.784915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1375/2716] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:44.784915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85404-6127-4093-9003-119a6090345b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.784915 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-42a85404-6127-4093-9003-119a6090345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:44.820723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc459-bdc0-4aa5-9ca4-873518bee095 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.826002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.827081 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.827781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.828138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.854927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85404-6127-4093-9003-119a6090345b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.859770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.860427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.860712 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.860997 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.872141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.873685 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.886255 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1376/2717] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:44.887334 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.900359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50263-3aff-4aa8-ac1b-324e761e2336 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.907718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:44.909122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:44.909540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:44.909926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] PATH_INFO: `/v3/projects/50e5cc3b586f476fa912a98105754346/users/1c996c9972ae41ac839da68e4faa4930/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:44.926462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.928164 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.941340 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e5cc3b586f476fa912a98105754346, user_id=1c996c9972ae41ac839da68e4faa4930, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:44.944788 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:44.953583 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1342/2718] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:44.968122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1377/2719] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:44 2022] PUT /identity/v3/projects/50e5cc3b586f476fa912a98105754346/users/1c996c9972ae41ac839da68e4faa4930/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:44.972342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:44.989799 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae79e-2436-4359-a4d4-7526229a151d service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:44.992032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:45.074695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5273e5-9b53-422c-8fea-81aa2a6e1c4a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:45.080206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:45.081033 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:45.081449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:45.081816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:45.102208 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:45.103205 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:45.103570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:45.104099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:45.106341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:45.110077 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:45.123074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1343/2720] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:06:45.127197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:45.140145 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c4f89-3349-428c-9aa5-281199d45d1c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:45.153256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:45.154872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:45.156233 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:45.156540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] PATH_INFO: `/v3/projects/50e5cc3b586f476fa912a98105754346/users/1c996c9972ae41ac839da68e4faa4930/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:45.160458 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e5cc3b586f476fa912a98105754346, user_id=1c996c9972ae41ac839da68e4faa4930, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:45.164444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:45.181430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:45.190979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86d9f-82a1-42d1-8e54-7f8e95f42b7e service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:45.193292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1344/2721] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:06:45 2022] PUT /identity/v3/projects/50e5cc3b586f476fa912a98105754346/users/1c996c9972ae41ac839da68e4faa4930/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:45.234131 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1378/2722] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:06:45.569223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:45.696917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c739-7140-4feb-a4f3-a424740c0453 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:45.702635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:45.704003 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:45.704289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:45.704580 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] PATH_INFO: `/v3/users/c67768c35ada4f4b88634c86f81c0c77` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:45.706101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67768c35ada4f4b88634c86f81c0c77)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:45.708043 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:45.775359 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67768c35ada4f4b88634c86f81c0c77'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:45.790945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67768c35ada4f4b88634c86f81c0c77'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:45.800130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67768c35ada4f4b88634c86f81c0c77'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:45.801156 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67768c35ada4f4b88634c86f81c0c77'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:45.802075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67768c35ada4f4b88634c86f81c0c77'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:45.823896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1345/2723] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:45 2022] DELETE /identity/v3/users/c67768c35ada4f4b88634c86f81c0c77 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:45.825424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43d77-40b3-4245-a3c8-2944603f646c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:45.826480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43d77-40b3-4245-a3c8-2944603f646c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:45.826783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43d77-40b3-4245-a3c8-2944603f646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:45.845010 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-37e43d77-40b3-4245-a3c8-2944603f646c None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:45.846345 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-37e43d77-40b3-4245-a3c8-2944603f646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:45.933803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1379/2724] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:45.940904 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:45.943357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:46.033905 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92e7a-3307-487a-a85a-b285468ced07 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:46.052444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:46.058533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:46.058841 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:46.059129 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:46.068308 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:46.068767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:46.069042 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:46.101083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:46.103826 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:46.104254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] MFA Rules not processed for user `1c996c9972ae41ac839da68e4faa4930`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:46.105645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:46.129995 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1346/2725] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:46.290936 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1380/2726] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:46.292777 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:46.294786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:46.428099 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1257-6d2b-4cb8-832a-90d943059bf7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:46.438344 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:46.439042 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:46.439362 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:46.439585 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:46.442595 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:46.554238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:46.556357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:46.570842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1347/2727] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:46.636222 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:46.638136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:46.662604 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ce09c-42fa-4a5e-b403-a4145735374c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:46.695128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:46.696012 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:46.696297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:46.696899 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] PATH_INFO: `/v3/projects/08c122c7f24b441db51a296b8855458b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:46.700904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c122c7f24b441db51a296b8855458b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:46.700904 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:46.786512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c122c7f24b441db51a296b8855458b', 'request_id': 'req-1530103a-4f19-495c-b786-da3b9a4a126e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:46.792302 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c122c7f24b441db51a296b8855458b', 'request_id': 'req-1530103a-4f19-495c-b786-da3b9a4a126e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:46.802524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c122c7f24b441db51a296b8855458b', 'request_id': 'req-1530103a-4f19-495c-b786-da3b9a4a126e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:46.820711 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] The token cache is being invalidate because project 08c122c7f24b441db51a296b8855458b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:46.821078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:46.821874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:46.828802 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1381/2728] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:46 2022] DELETE /identity/v3/projects/08c122c7f24b441db51a296b8855458b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:46.830041 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:46.843316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aaf0c-43e9-481e-aafa-6c101725927c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:46.929570 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:46.930460 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:46.930807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:46.931093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] PATH_INFO: `/v3/users/f38aa13aa093480681067e719d7cc2c3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:46.932353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38aa13aa093480681067e719d7cc2c3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:46.934498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:46.999986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38aa13aa093480681067e719d7cc2c3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.014281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38aa13aa093480681067e719d7cc2c3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.024765 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38aa13aa093480681067e719d7cc2c3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.025579 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38aa13aa093480681067e719d7cc2c3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.026444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38aa13aa093480681067e719d7cc2c3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.041318 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1348/2729] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:06:46 2022] DELETE /identity/v3/users/f38aa13aa093480681067e719d7cc2c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:06:47.357569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:47.359239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:47.381827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530103a-4f19-495c-b786-da3b9a4a126e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:47.496661 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:47.498208 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:47.498751 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:47.499149 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] PATH_INFO: `/v3/projects/f738263a60234d25a6f1daaf0e2e1982` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:47.500667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f738263a60234d25a6f1daaf0e2e1982)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:47.503141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:47.563985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f738263a60234d25a6f1daaf0e2e1982', 'request_id': 'req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.572846 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f738263a60234d25a6f1daaf0e2e1982', 'request_id': 'req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.582931 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f738263a60234d25a6f1daaf0e2e1982', 'request_id': 'req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.601681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] The token cache is being invalidate because project f738263a60234d25a6f1daaf0e2e1982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:06:47.602026 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.603409 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7c16f4a2-4229-4670-b9c6-249a0cec6fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:06:47.605078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1382/2730] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:06:47 2022] DELETE /identity/v3/projects/f738263a60234d25a6f1daaf0e2e1982 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:06:48.035885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:48.037542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:48.099424 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2159-20c9-4f67-b237-b074d782e5ca admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:48.158738 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:48.159385 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:48.159670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:48.159948 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:48.161722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:48.223182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:48.225155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:48.240342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1349/2731] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:06:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:06:57.940979 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:57.941524 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:57.941616 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:57.960470 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] MFA Rules not processed for user `859e14db8cca4e4688078ef692a8b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:06:57.961727 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:58.015483 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1383/2732] 10.222.0.44 () {58 vars in 967 bytes} [Wed May 11 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:06:58.028058 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:06:58.029542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:06:58.097622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050406-9b37-4498-8c63-91863314c2a4 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:06:58.102791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8fda86f5de6480f98993a7a5888112a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:06:58.103433 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:06:58.103717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:06:58.104000 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:06:58.112477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:06:58.114133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:06:58.121874 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1350/2733] 10.222.0.44 () {60 vars in 1384 bytes} [Wed May 11 06:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:07:00.189980 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:00.191511 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:00.256837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bde0d-7a04-4baa-ae7f-cafc89c291dc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:00.261321 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:00.262771 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:00.263059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:00.263332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] PATH_INFO: `/v3/users/34e24c80364642b083dc32697f7320ad` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:00.264530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e24c80364642b083dc32697f7320ad)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:00.266757 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:00.310665 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e24c80364642b083dc32697f7320ad'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.321884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e24c80364642b083dc32697f7320ad'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.322556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e24c80364642b083dc32697f7320ad'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.323162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e24c80364642b083dc32697f7320ad'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.330261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e24c80364642b083dc32697f7320ad'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.342139 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1384/2734] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:00 2022] DELETE /identity/v3/users/34e24c80364642b083dc32697f7320ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:00.522457 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:00.541599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f43c6-2ad8-4ac2-8f80-bf8a0c56aca7 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:00.619462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:00.620384 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:00.620678 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:00.621008 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] PATH_INFO: `/v3/projects/a40603d2f46d4ad2986e9277a47a8211` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:00.622676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40603d2f46d4ad2986e9277a47a8211)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:00.624728 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:00.644046 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:00.645498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:00.662227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad086d-b4ae-416d-8295-56ca22787c32 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:00.667421 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:00.668403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:00.668879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:00.669777 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] PATH_INFO: `/v3/users/4eefd77986c3435385a9f839e7b4fee1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:00.671085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eefd77986c3435385a9f839e7b4fee1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:00.673129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:00.682005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40603d2f46d4ad2986e9277a47a8211', 'request_id': 'req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.687821 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40603d2f46d4ad2986e9277a47a8211', 'request_id': 'req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.694258 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40603d2f46d4ad2986e9277a47a8211', 'request_id': 'req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.708209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] The token cache is being invalidate because project a40603d2f46d4ad2986e9277a47a8211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:00.708510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.709250 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7e7d00f5-86a1-44ae-a3cf-01fd68693d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.711100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1351/2735] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:00 2022] DELETE /identity/v3/projects/a40603d2f46d4ad2986e9277a47a8211 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:00.728484 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eefd77986c3435385a9f839e7b4fee1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.745388 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eefd77986c3435385a9f839e7b4fee1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.746341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eefd77986c3435385a9f839e7b4fee1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.747220 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eefd77986c3435385a9f839e7b4fee1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.756449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eefd77986c3435385a9f839e7b4fee1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:00.771104 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1385/2736] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:00 2022] DELETE /identity/v3/users/4eefd77986c3435385a9f839e7b4fee1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:00.775644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:00.775943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:00.776230 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:00.796073 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:00.797342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:00.869556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1352/2737] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:00.880585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:00.882326 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:00.954461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d018a-6c45-4347-b8a4-350fc83ff73c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:00.958116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:00.958794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:00.959077 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:00.959355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:00.970214 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:00.971708 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:00.981717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1386/2738] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:01.419295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:01.421839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:01.434022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967dab-c5cf-419f-ae35-05561bb50106 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:01.439947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:01.440823 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:01.441299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:01.441616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] PATH_INFO: `/v3/projects/6a02a3c80bf34e71a63f8da7c1681493` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:01.442824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a02a3c80bf34e71a63f8da7c1681493)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:01.444906 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:01.496257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a02a3c80bf34e71a63f8da7c1681493', 'request_id': 'req-29f351db-823b-4b81-bcf0-96c9d9ef9830'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.502943 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a02a3c80bf34e71a63f8da7c1681493', 'request_id': 'req-29f351db-823b-4b81-bcf0-96c9d9ef9830'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.518223 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a02a3c80bf34e71a63f8da7c1681493', 'request_id': 'req-29f351db-823b-4b81-bcf0-96c9d9ef9830'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.531633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] The token cache is being invalidate because project 6a02a3c80bf34e71a63f8da7c1681493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:01.532296 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.532791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.534393 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1353/2739] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:01 2022] DELETE /identity/v3/projects/6a02a3c80bf34e71a63f8da7c1681493 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:01.538498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:01.548231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749744e-2b25-4dff-9aaf-4a4ea6dfeab9 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:01.603998 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:01.604876 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:01.605162 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:01.605442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] PATH_INFO: `/v3/users/55de0e203ac54f85a7f663ed7ca4274f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:01.607303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=55de0e203ac54f85a7f663ed7ca4274f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:01.609358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:01.656872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55de0e203ac54f85a7f663ed7ca4274f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.669752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55de0e203ac54f85a7f663ed7ca4274f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.670479 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55de0e203ac54f85a7f663ed7ca4274f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.671079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55de0e203ac54f85a7f663ed7ca4274f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.678333 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55de0e203ac54f85a7f663ed7ca4274f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.691407 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1387/2740] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:01 2022] DELETE /identity/v3/users/55de0e203ac54f85a7f663ed7ca4274f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:01.799354 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:01.800868 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:01.815734 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f351db-823b-4b81-bcf0-96c9d9ef9830 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:01.876270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:01.877158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:01.877512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:01.878363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] PATH_INFO: `/v3/users/ed8d9ac660614df6a99a029d23aca057` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:01.879829 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8d9ac660614df6a99a029d23aca057)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:01.881813 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:01.938884 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8d9ac660614df6a99a029d23aca057'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.951670 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8d9ac660614df6a99a029d23aca057'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.958960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8d9ac660614df6a99a029d23aca057'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.959688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8d9ac660614df6a99a029d23aca057'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.960313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8d9ac660614df6a99a029d23aca057'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:01.973831 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1354/2741] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:01 2022] DELETE /identity/v3/users/ed8d9ac660614df6a99a029d23aca057 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:02.039058 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.040621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.064105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444388d5-f039-4252-a656-47f729a229fb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.128901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.130300 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.130594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.130879 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] PATH_INFO: `/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.132128 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc8538a0e4d464fb3fefd6d67ef31fd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.134237 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.156764 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.158260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.186342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6dd32-9642-4eb9-9e65-89427b2b29e8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.194121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc8538a0e4d464fb3fefd6d67ef31fd', 'request_id': 'req-f0fce856-3371-4d8a-b184-e3c3f4a0545f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.199622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc8538a0e4d464fb3fefd6d67ef31fd', 'request_id': 'req-f0fce856-3371-4d8a-b184-e3c3f4a0545f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.208125 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc8538a0e4d464fb3fefd6d67ef31fd', 'request_id': 'req-f0fce856-3371-4d8a-b184-e3c3f4a0545f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.220812 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] The token cache is being invalidate because project 4bc8538a0e4d464fb3fefd6d67ef31fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:02.221097 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.221767 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f0fce856-3371-4d8a-b184-e3c3f4a0545f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.223673 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1388/2742] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:02 2022] DELETE /identity/v3/projects/4bc8538a0e4d464fb3fefd6d67ef31fd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:02.228192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a18ae-2935-4c47-95aa-09bab01fcaf6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.228488 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a18ae-2935-4c47-95aa-09bab01fcaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.228772 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a18ae-2935-4c47-95aa-09bab01fcaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.246346 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.247275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.247650 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.247846 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] PATH_INFO: `/v3/projects/8582e121f5364a8182e98933641b58af` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.248803 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2c8a18ae-2935-4c47-95aa-09bab01fcaf6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:02.249084 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8582e121f5364a8182e98933641b58af)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.250144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2c8a18ae-2935-4c47-95aa-09bab01fcaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.251178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.258099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1389/2743] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:02.266642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.266946 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.267225 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.287118 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:02.288312 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.297413 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8582e121f5364a8182e98933641b58af', 'request_id': 'req-31aa8d4a-6ccb-4ff7-9817-c8209173840c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.302703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8582e121f5364a8182e98933641b58af', 'request_id': 'req-31aa8d4a-6ccb-4ff7-9817-c8209173840c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.308972 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8582e121f5364a8182e98933641b58af', 'request_id': 'req-31aa8d4a-6ccb-4ff7-9817-c8209173840c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.321676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] The token cache is being invalidate because project 8582e121f5364a8182e98933641b58af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:02.322016 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.322653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.324241 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1355/2744] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:02 2022] DELETE /identity/v3/projects/8582e121f5364a8182e98933641b58af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:02.328505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.329852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.348298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1390/2745] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:02.352493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.361705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad6750-dce8-42ec-87c3-20b9fd366e57 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.366316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.366966 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.367253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.367534 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.368261 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:07:02.368700 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.370335 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.384741 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1391/2746] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:07:02.385683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.392658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8d4a-6ccb-4ff7-9817-c8209173840c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.395808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42400-8c80-4ee2-85f9-e144730ce9f4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.397245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.398153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.398423 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.398818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] PATH_INFO: `/v3/users/1c996c9972ae41ac839da68e4faa4930` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.400151 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c996c9972ae41ac839da68e4faa4930)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.400412 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.401038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.401352 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.401657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.402087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.402336 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.404311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.433554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1392/2747] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:02.435690 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.449194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c996c9972ae41ac839da68e4faa4930'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.460659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c996c9972ae41ac839da68e4faa4930'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.467505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c996c9972ae41ac839da68e4faa4930'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.468217 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c996c9972ae41ac839da68e4faa4930'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.468852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c996c9972ae41ac839da68e4faa4930'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.482342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1356/2748] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:02 2022] DELETE /identity/v3/users/1c996c9972ae41ac839da68e4faa4930 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:02.502442 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476787-fedb-4410-b61c-e5e6103a8698 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.558799 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.560094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.560310 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.560625 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.561281 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.563287 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.583266 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1393/2749] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:07:02.587565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.589036 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.602430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a368-8cfb-4ad1-a041-092e78a23216 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.607886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.608560 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.608851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.609139 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.609909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.611511 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.625083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1357/2750] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:02.626311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.636808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754bbb-1c4b-40a8-8cef-8dd787cffb42 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.642836 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.643501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.643801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.644136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.644992 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.646796 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.662478 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1394/2751] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:02.663382 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.665265 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.667172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.679049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccbd4e-abb1-4222-8a95-af59ed0dd3b6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.684344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.686747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.687085 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.687342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] PATH_INFO: `/v3/projects/d2c5c975031d408e9a7b6e58b95f8d8f/users/bf069098673048748664df216fb54b30/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.691564 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec468f13-b8dc-4b2b-af2d-fb68bddbb830 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.697251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.698216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.698502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.698973 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] PATH_INFO: `/v3/projects/50e5cc3b586f476fa912a98105754346` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.701565 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e5cc3b586f476fa912a98105754346)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.703773 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.705068 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c5c975031d408e9a7b6e58b95f8d8f, user_id=bf069098673048748664df216fb54b30, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.708489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150e57-8a65-4579-bfe2-884776fdee26 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.725106 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1395/2752] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:02 2022] PUT /identity/v3/projects/d2c5c975031d408e9a7b6e58b95f8d8f/users/bf069098673048748664df216fb54b30/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:02.737490 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.737971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.738160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.753682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e5cc3b586f476fa912a98105754346', 'request_id': 'req-866f830f-ea71-4788-8dc4-e56ec18062e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.759040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e5cc3b586f476fa912a98105754346', 'request_id': 'req-866f830f-ea71-4788-8dc4-e56ec18062e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.765548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] MFA Rules not processed for user `bf069098673048748664df216fb54b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:02.766253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e5cc3b586f476fa912a98105754346', 'request_id': 'req-866f830f-ea71-4788-8dc4-e56ec18062e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.767160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.779701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] The token cache is being invalidate because project 50e5cc3b586f476fa912a98105754346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:02.779998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.780635 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-866f830f-ea71-4788-8dc4-e56ec18062e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:02.782251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1358/2753] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:02 2022] DELETE /identity/v3/projects/50e5cc3b586f476fa912a98105754346 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:02.786996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1806-33a7-45cc-a3d9-f749e2a9f43f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.787292 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1806-33a7-45cc-a3d9-f749e2a9f43f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.787578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1806-33a7-45cc-a3d9-f749e2a9f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.805309 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-313a1806-33a7-45cc-a3d9-f749e2a9f43f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:02.806545 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-313a1806-33a7-45cc-a3d9-f749e2a9f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.834697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1396/2754] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:02.839177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.840635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.868166 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1359/2755] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:02.877214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.877656 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.877947 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.897455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:02.898709 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:02.905282 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7629e-e1f0-4203-b3c8-1d6d1f0f97f7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.907882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1360/2756] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:02.911569 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.911952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.912230 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.912517 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.912795 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.913501 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.915472 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.921419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed045-18af-4245-942f-fea6743ec292 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:02.926247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:02.926886 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:02.927172 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:02.927447 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:02.928163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:07:02.928470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:02.930093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:02.942292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1397/2757] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:07:02.949052 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1361/2758] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:07:02.949203 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.950281 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:02.960197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153e77c-72b4-4003-8fe6-b99fc1cee167 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.013226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a948e-0ff2-4312-b88c-b745ab3ea291 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.018295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.018954 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.019238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.019515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.020200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.022231 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.022404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.023060 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.023343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.023620 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.024304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.026214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.042832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1398/2759] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:07:03.047859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.056247 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1362/2760] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:02 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:07:03.057211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.057386 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80184d2-2632-4955-b997-0298622941ec admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.112368 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.113156 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.113445 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.113760 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.114480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.116080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.116462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dfa40-e0a3-4b3a-b698-81adb90d238e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.121189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.122159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.122445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.122725 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.123407 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.125339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.126008 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1399/2761] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:03.130153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.141563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4a8a-6ad2-42f4-bd88-04bdd4a5fb3f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.146615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.147504 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.147813 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.148094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] PATH_INFO: `/v3/projects/47d175ce9532400ea263fb133dc1409b/users/d8d14117c0a3454da175ab42f59a2291/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.153655 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1363/2762] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:03 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:03.154732 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.163427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d175ce9532400ea263fb133dc1409b, user_id=d8d14117c0a3454da175ab42f59a2291, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.164542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360964-4de5-41d0-bfd6-ff6809f1b57d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.166251 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.169939 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.170602 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.170891 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.171270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.172123 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.174502 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.181563 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1400/2763] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:03 2022] PUT /identity/v3/projects/47d175ce9532400ea263fb133dc1409b/users/d8d14117c0a3454da175ab42f59a2291/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:03.186036 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.189213 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1364/2764] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:03.193343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.202810 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fcd6-9c21-4ff4-ae16-5cbfae9ad3a1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.247549 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab702-1671-44a2-962f-a108b09aaa6c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.252390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.253006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.253288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.253596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.254327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.255924 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.258525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.259215 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.259505 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.259789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.260518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.262182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.266378 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1401/2765] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:03.270427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.275682 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1365/2766] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:03.276665 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.280056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06fdf-1108-4c96-bc4c-9feec76a9a86 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.284679 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.285570 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.285858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.286134 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] PATH_INFO: `/v3/projects/47d175ce9532400ea263fb133dc1409b/users/d8d14117c0a3454da175ab42f59a2291/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.286238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce1b4a-6529-434a-91e0-ac32b9ad5bd8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.288174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d175ce9532400ea263fb133dc1409b, user_id=d8d14117c0a3454da175ab42f59a2291, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.290817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.290975 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c98d6-d4bb-4b29-8088-bda67d999187 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.291673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.291957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.292235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] PATH_INFO: `/v3/projects/6662433dede04f40bc3e84fb4644fc44/users/f38868ee1e214ea3a02930ca936b34a1/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.301358 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1402/2767] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:03 2022] PUT /identity/v3/projects/47d175ce9532400ea263fb133dc1409b/users/d8d14117c0a3454da175ab42f59a2291/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:03.307162 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6662433dede04f40bc3e84fb4644fc44, user_id=f38868ee1e214ea3a02930ca936b34a1, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.310421 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5a07-0f19-4f2a-b264-9cdab7d69b35 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.313218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.313571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.313858 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.323253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1366/2768] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:03 2022] PUT /identity/v3/projects/6662433dede04f40bc3e84fb4644fc44/users/f38868ee1e214ea3a02930ca936b34a1/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:03.333327 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.333769 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.334059 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.341254 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] MFA Rules not processed for user `d8d14117c0a3454da175ab42f59a2291`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:03.342862 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:03.360442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] MFA Rules not processed for user `f38868ee1e214ea3a02930ca936b34a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:03.361675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:03.409933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1403/2769] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:03.421399 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.422870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:03.424830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1367/2770] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:03.436721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.438108 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:03.479416 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c122ba-32d0-4d31-a35d-6bc8ed11b7f7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.484052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.484697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.485003 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.485259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.493622 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3cb38-a8e7-493c-9582-c8b491494d5c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.494099 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.495540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.497548 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.498197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.498488 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.498771 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.505437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1404/2771] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:07:03.507321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.508759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.518079 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1368/2772] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:07:03.553743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:03.562424 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06e5ed-f1b2-41c9-8bd6-1a59afb36a0b service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:03.566153 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:03.566814 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:03.567094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:03.567365 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:03.624925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:03.626583 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c901c5-6e32-476a-a979-f86be0ce52a2 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:03.635657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1405/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:06.055963 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:06.116847 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3753ae-81d9-47d8-b183-44698584db15 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:06.121370 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:06.122267 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:06.122554 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:06.122839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] PATH_INFO: `/v3/users/f38868ee1e214ea3a02930ca936b34a1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:06.124022 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38868ee1e214ea3a02930ca936b34a1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:06.125991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:06.170702 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38868ee1e214ea3a02930ca936b34a1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.182320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38868ee1e214ea3a02930ca936b34a1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.189589 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38868ee1e214ea3a02930ca936b34a1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.190302 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38868ee1e214ea3a02930ca936b34a1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.190914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38868ee1e214ea3a02930ca936b34a1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.204885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1369/2774] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:06 2022] DELETE /identity/v3/users/f38868ee1e214ea3a02930ca936b34a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:06.209380 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:06.209878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:06.210013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:06.227548 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:06.228740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:06.285808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1406/2775] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:06.295435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:06.296882 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:06.352478 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e42b-f282-4cc7-9cfc-aab55036beba admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:06.356097 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:06.356854 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:06.357136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:06.357416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:06.366895 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:06.368361 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:06.377879 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1370/2776] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:06.635462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:06.636969 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:06.652706 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52247e-70f4-49b2-a918-d54755c9bd03 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:06.658693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:06.659863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:06.660140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:06.660458 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] PATH_INFO: `/v3/projects/6662433dede04f40bc3e84fb4644fc44` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:06.661739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6662433dede04f40bc3e84fb4644fc44)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:06.663683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:06.712372 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6662433dede04f40bc3e84fb4644fc44', 'request_id': 'req-35314124-684d-4026-b4bd-66f76c31a670'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.719695 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6662433dede04f40bc3e84fb4644fc44', 'request_id': 'req-35314124-684d-4026-b4bd-66f76c31a670'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.729437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6662433dede04f40bc3e84fb4644fc44', 'request_id': 'req-35314124-684d-4026-b4bd-66f76c31a670'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.740996 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] The token cache is being invalidate because project 6662433dede04f40bc3e84fb4644fc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:06.741723 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.742049 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-35314124-684d-4026-b4bd-66f76c31a670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:06.743657 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1407/2777] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:06 2022] DELETE /identity/v3/projects/6662433dede04f40bc3e84fb4644fc44 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:06.880403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:06.881867 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:06.895046 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e517f-33ae-4326-b873-ff03be4edd40 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:06.956556 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:06.957446 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:06.957763 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:06.958045 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] PATH_INFO: `/v3/users/bf069098673048748664df216fb54b30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:06.959314 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf069098673048748664df216fb54b30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:06.961266 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:07.008491 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf069098673048748664df216fb54b30'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.019855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf069098673048748664df216fb54b30'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.026304 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf069098673048748664df216fb54b30'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.026960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf069098673048748664df216fb54b30'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.027561 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf069098673048748664df216fb54b30'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.039428 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1371/2778] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:06 2022] DELETE /identity/v3/users/bf069098673048748664df216fb54b30 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:07.044903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:07.045361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:07.045692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:07.064296 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:07.065522 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:07.123140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1408/2779] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:07.132639 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:07.134057 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:07.191372 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dd869-1e12-4817-bc28-8dfcc449ad6b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:07.194976 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:07.195616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:07.195901 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:07.196176 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:07.204971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:07.206426 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:07.216325 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1372/2780] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:07.470192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:07.471634 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:07.484718 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f92113-ebd7-48ff-ba2a-292a7a2e78dc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:07.489587 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:07.490554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:07.490930 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:07.491211 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] PATH_INFO: `/v3/projects/d2c5c975031d408e9a7b6e58b95f8d8f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:07.492391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c5c975031d408e9a7b6e58b95f8d8f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:07.494375 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:07.540385 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c5c975031d408e9a7b6e58b95f8d8f', 'request_id': 'req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.546912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c5c975031d408e9a7b6e58b95f8d8f', 'request_id': 'req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.554218 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c5c975031d408e9a7b6e58b95f8d8f', 'request_id': 'req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.565797 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] The token cache is being invalidate because project d2c5c975031d408e9a7b6e58b95f8d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:07.566177 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.566863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.568628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1409/2781] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:07 2022] DELETE /identity/v3/projects/d2c5c975031d408e9a7b6e58b95f8d8f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:07.572907 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:07.584922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267b052-6eef-4ffa-b251-dde9324ef310 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:07.638485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:07.639416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:07.639704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:07.639983 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] PATH_INFO: `/v3/users/d8d14117c0a3454da175ab42f59a2291` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:07.641435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d14117c0a3454da175ab42f59a2291)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:07.643406 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:07.689350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d14117c0a3454da175ab42f59a2291'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.702526 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d14117c0a3454da175ab42f59a2291'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.709257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d14117c0a3454da175ab42f59a2291'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.709996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d14117c0a3454da175ab42f59a2291'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.710598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b6958912-9017-467b-b248-ca6e3db8822e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d14117c0a3454da175ab42f59a2291'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:07.723711 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1373/2782] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:07 2022] DELETE /identity/v3/users/d8d14117c0a3454da175ab42f59a2291 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:08.015362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.017361 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:08.037209 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff2af-45f1-4dfe-a044-ed380f3c0400 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.118288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.119681 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.120154 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.120622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] PATH_INFO: `/v3/projects/47d175ce9532400ea263fb133dc1409b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.123069 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d175ce9532400ea263fb133dc1409b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.126191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.183800 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d175ce9532400ea263fb133dc1409b', 'request_id': 'req-7a7c5b58-1def-49ea-9066-2d63a0c1af62'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:08.190423 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d175ce9532400ea263fb133dc1409b', 'request_id': 'req-7a7c5b58-1def-49ea-9066-2d63a0c1af62'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:08.198973 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d175ce9532400ea263fb133dc1409b', 'request_id': 'req-7a7c5b58-1def-49ea-9066-2d63a0c1af62'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:08.211359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] The token cache is being invalidate because project 47d175ce9532400ea263fb133dc1409b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:08.212366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:08.213021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7a7c5b58-1def-49ea-9066-2d63a0c1af62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:08.214652 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1410/2783] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:08 2022] DELETE /identity/v3/projects/47d175ce9532400ea263fb133dc1409b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:08.220193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.220193 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.220739 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.241251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:08.243532 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:08.311987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1374/2784] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:08.319852 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.320146 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.320435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.342658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:08.343928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:08.352667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1411/2785] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:08.358816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.368802 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5151-43fc-470c-923b-5ceb39379aaf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.374510 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.375168 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.376214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.376214 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.376462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:07:08.376778 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.379780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.394146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1375/2786] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:07:08.399502 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.411584 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705f46-0cc3-4a21-bfff-a899e8501e21 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.417191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.418004 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.418288 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.419316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.420332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.422393 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.452394 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1412/2787] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:08.453735 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.464103 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948deef-2a47-4774-8d84-60b2f265ffe9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.522395 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.523072 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.523363 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.523644 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.524392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.526350 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.546629 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1376/2788] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:08.550983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.562175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcd38-1a19-4fcc-810a-b3b801ea5844 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.566884 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.567544 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.567829 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.568144 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.569090 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.570728 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.582184 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1413/2789] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:08.586257 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.596701 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7259d8-d5d2-4f34-a1ae-34d625197bb4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.601275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.601952 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.602238 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.602516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.603231 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.604803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0896d6-5acc-4a2e-a9ba-33e5d3c85288 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.614672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1377/2790] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:08.618644 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.628603 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6f4f-b233-4dcf-852f-1cdd506fdeee admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.633169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.634080 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.634367 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.634645 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] PATH_INFO: `/v3/projects/f4ed3383ad37423f84d80c26d424fd45/users/988367ac25054d52914c14477f0d6bd7/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.649815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ed3383ad37423f84d80c26d424fd45, user_id=988367ac25054d52914c14477f0d6bd7, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.652493 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.666875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1414/2791] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:08 2022] PUT /identity/v3/projects/f4ed3383ad37423f84d80c26d424fd45/users/988367ac25054d52914c14477f0d6bd7/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:08.678204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.678498 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.678790 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.705125 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] MFA Rules not processed for user `988367ac25054d52914c14477f0d6bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:08.706476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:08.769721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1378/2792] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:08.774449 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.833791 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616d7a0-f815-4821-913b-27881daf3a80 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.838419 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.839059 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.839342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.839619 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.840303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.842347 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.865693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1415/2793] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:08.869707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.880516 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aac84-9302-45f7-894a-9f14769769bc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.933706 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.934940 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.935222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.935496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.936268 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.938199 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.959138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1379/2794] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:08 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:08.963241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:08.973292 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913d22-27fa-49db-9104-9cce0a6909ed admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:08.977921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:08.978572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:08.978883 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:08.979137 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:08.979859 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:08.981699 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:08.991909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1416/2795] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:08.995953 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:09.006638 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7497e-eac6-443a-b230-db752bd84014 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:09.011256 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:09.012137 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:09.012476 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:09.013263 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] PATH_INFO: `/v3/projects/185fd34ae4e244b88e223e0b37f7c04e/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:09.028269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185fd34ae4e244b88e223e0b37f7c04e, user_id=b6e3bdbd6c3d454dbd0bfec35cffcbd2, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:09.030954 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:09.043876 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1380/2796] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:08 2022] PUT /identity/v3/projects/185fd34ae4e244b88e223e0b37f7c04e/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:09.047951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:09.058057 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341e20-561d-44e8-8dab-c5e437454a79 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:09.116532 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:09.117194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:09.117498 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:09.117878 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:09.118736 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:09.120324 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ac6d6-3a55-4ac6-b33f-81041e3975d1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:09.130429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1417/2797] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:09.134785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:09.145543 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b115-6870-421a-b863-16790289ecd5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:09.150141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:09.151024 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:09.151321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:09.151619 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] PATH_INFO: `/v3/projects/185fd34ae4e244b88e223e0b37f7c04e/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:09.153908 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185fd34ae4e244b88e223e0b37f7c04e, user_id=b6e3bdbd6c3d454dbd0bfec35cffcbd2, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:09.156533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:09.166679 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1381/2798] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:09 2022] PUT /identity/v3/projects/185fd34ae4e244b88e223e0b37f7c04e/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:09.177280 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:09.177601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:09.177890 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:09.204000 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] MFA Rules not processed for user `b6e3bdbd6c3d454dbd0bfec35cffcbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:09.205187 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:09.270105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1418/2799] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:09.280704 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:09.282429 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:09.340068 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5126b-acaf-4876-87cd-4bf7d80ed5a7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:09.344005 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:09.344640 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:09.344989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:09.345282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:09.400063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:09.401523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:09.410519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1382/2800] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:13.543200 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:13.545297 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:13.557017 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40838dbd-f068-458b-b63d-9c1303fa7af9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:13.560693 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:13.561338 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:13.561668 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:13.561951 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:13.570745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:13.572192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17770b-487d-4d3f-b4d5-e756aa409809 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:13.582172 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1419/2801] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:18.418158 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:18.477365 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a11e0-25d3-4045-903a-ae243ff9e9eb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:18.481878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:18.482768 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:18.483053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:18.483332 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] PATH_INFO: `/v3/users/988367ac25054d52914c14477f0d6bd7` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:18.484499 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988367ac25054d52914c14477f0d6bd7)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:18.486437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:18.531835 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988367ac25054d52914c14477f0d6bd7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:18.542964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988367ac25054d52914c14477f0d6bd7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:18.549756 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988367ac25054d52914c14477f0d6bd7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:18.550425 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988367ac25054d52914c14477f0d6bd7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:18.551035 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988367ac25054d52914c14477f0d6bd7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:18.563922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1383/2802] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:18 2022] DELETE /identity/v3/users/988367ac25054d52914c14477f0d6bd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:18.568508 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233038e7-2870-4776-a20f-18405646c553 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:18.568994 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233038e7-2870-4776-a20f-18405646c553 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:18.569133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233038e7-2870-4776-a20f-18405646c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:18.586968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-233038e7-2870-4776-a20f-18405646c553 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:18.588206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-233038e7-2870-4776-a20f-18405646c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:18.644596 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1420/2803] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:18.654249 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:18.655567 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:18.712461 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c22b-cdbd-44fe-bbd2-514e9c59b861 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:18.716260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:18.716899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:18.717189 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:18.717507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:18.726352 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:18.727781 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:18.737127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1384/2804] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:18.996438 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233038e7-2870-4776-a20f-18405646c553 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:18.997937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-233038e7-2870-4776-a20f-18405646c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:19.009981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233038e7-2870-4776-a20f-18405646c553 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.015390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.016617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.016928 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.017206 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] PATH_INFO: `/v3/projects/f4ed3383ad37423f84d80c26d424fd45` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.018530 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ed3383ad37423f84d80c26d424fd45)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.020496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.066903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ed3383ad37423f84d80c26d424fd45', 'request_id': 'req-67991475-3935-44be-845b-62bfcaddea0f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.072236 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ed3383ad37423f84d80c26d424fd45', 'request_id': 'req-67991475-3935-44be-845b-62bfcaddea0f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.079792 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ed3383ad37423f84d80c26d424fd45', 'request_id': 'req-67991475-3935-44be-845b-62bfcaddea0f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.092520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] The token cache is being invalidate because project f4ed3383ad37423f84d80c26d424fd45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:19.092871 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.094133 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.095719 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1421/2805] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:18 2022] DELETE /identity/v3/projects/f4ed3383ad37423f84d80c26d424fd45 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:19.099752 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.110409 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885eafa-c262-4c74-a7f8-21700687b1b7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.165807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.166677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.166962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.167244 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] PATH_INFO: `/v3/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.168420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e3bdbd6c3d454dbd0bfec35cffcbd2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.171089 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.214849 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e3bdbd6c3d454dbd0bfec35cffcbd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.226803 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e3bdbd6c3d454dbd0bfec35cffcbd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.234507 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e3bdbd6c3d454dbd0bfec35cffcbd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.235179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e3bdbd6c3d454dbd0bfec35cffcbd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.235782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84aa653a-b47b-420f-835c-b0acddeba7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e3bdbd6c3d454dbd0bfec35cffcbd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.248761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1385/2806] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:19 2022] DELETE /identity/v3/users/b6e3bdbd6c3d454dbd0bfec35cffcbd2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:19.506381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.508160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:19.521581 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67991475-3935-44be-845b-62bfcaddea0f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.579035 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.579922 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.580210 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.580492 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] PATH_INFO: `/v3/projects/185fd34ae4e244b88e223e0b37f7c04e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.581717 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=185fd34ae4e244b88e223e0b37f7c04e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.583630 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.628745 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185fd34ae4e244b88e223e0b37f7c04e', 'request_id': 'req-e081cd32-ebb2-4125-a09a-3374a4d464ec'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.634129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185fd34ae4e244b88e223e0b37f7c04e', 'request_id': 'req-e081cd32-ebb2-4125-a09a-3374a4d464ec'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.642105 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185fd34ae4e244b88e223e0b37f7c04e', 'request_id': 'req-e081cd32-ebb2-4125-a09a-3374a4d464ec'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.652622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] The token cache is being invalidate because project 185fd34ae4e244b88e223e0b37f7c04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:19.652971 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.654122 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e081cd32-ebb2-4125-a09a-3374a4d464ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:19.655805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1422/2807] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:19 2022] DELETE /identity/v3/projects/185fd34ae4e244b88e223e0b37f7c04e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:19.663721 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.664235 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.664339 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.682590 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:19.683788 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:19.741865 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1386/2808] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:19.751050 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.751342 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.751628 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.769808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:19.771030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:19.778965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1423/2809] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:19.783130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.792808 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65a63-5790-48bd-86b8-16ea53b73000 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.797945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.798599 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.798910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.799197 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.799922 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:07:19.800264 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.801889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.813776 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1387/2810] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:07:19.818065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.827197 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3c58-d7ea-4dc6-9452-4b328382a8a6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.831750 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.832390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.832676 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.832956 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.833810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.835724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.861743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1424/2811] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:19 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:19.865936 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.876334 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5dfb9-78bc-4fba-a629-d5b4be882853 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.930878 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.931523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.931807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.932086 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.932782 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.935535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.954574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1388/2812] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:19 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:19.958720 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:19.969572 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b5e0-733d-4b83-adcd-d01508c1b1ae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:19.974249 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:19.974902 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:19.975186 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:19.975465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:19.976189 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:19.977827 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:19.988473 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1425/2813] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:19.992282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.001986 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2279-2ce2-4362-a2e6-37e309c2adc9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.006636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.007289 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.007576 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.007864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.008584 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.010216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effb81d-4121-4e27-b288-7bbdf4a80dd1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.020038 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1389/2814] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:20.023927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.034178 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1294b-c81b-464a-a83f-05810e6a4a3a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.038927 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.039781 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.040062 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.040362 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] PATH_INFO: `/v3/projects/e1cc42783b094edb9f2b5027a3359436/users/6d7951060688412fb95f932c5fbd8c6e/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.055195 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cc42783b094edb9f2b5027a3359436, user_id=6d7951060688412fb95f932c5fbd8c6e, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.057942 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.070649 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1426/2815] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:20 2022] PUT /identity/v3/projects/e1cc42783b094edb9f2b5027a3359436/users/6d7951060688412fb95f932c5fbd8c6e/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:20.082680 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.082977 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.083260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.110448 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] MFA Rules not processed for user `6d7951060688412fb95f932c5fbd8c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:20.111663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:20.175186 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1390/2816] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:20.179739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.239160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246e8e-3a14-47ec-b94c-e654d6d87033 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.243912 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.244512 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.244801 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.245079 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.245809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.247794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.272303 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1427/2817] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:20 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:07:20.276455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.287845 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faabb9-75bb-470d-8a84-cdd96a885807 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.342524 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.343179 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.343462 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.343736 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.344419 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.346358 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.365675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1391/2818] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:20 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:20.369944 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.380495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e1e0-ce19-44ec-ad7c-3f4fef056093 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.385001 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.385686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.385968 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.386247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.386955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.388697 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.399110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1428/2819] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:20.403112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.412710 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05642503-cb80-403f-8f78-57c2d973c65f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.417299 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.418206 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.419098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.419275 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] PATH_INFO: `/v3/projects/c72aacc5545b46b986c5178fe8dc33bf/users/10192bdef92943d5991f0b4d03d6ae1b/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.433152 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72aacc5545b46b986c5178fe8dc33bf, user_id=10192bdef92943d5991f0b4d03d6ae1b, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.436673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.449083 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1392/2820] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:20 2022] PUT /identity/v3/projects/c72aacc5545b46b986c5178fe8dc33bf/users/10192bdef92943d5991f0b4d03d6ae1b/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:20.453114 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.462901 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd9c8-4e4e-471a-bfbb-fa64de55991c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.517732 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.518316 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.518599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.518881 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.519598 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.521188 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6ce09-a37e-46d3-8132-da4fe965babf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.530923 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1429/2821] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:07:20.534989 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.545696 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68aa9-727d-413c-bd59-71bc126cb326 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.550188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.551056 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.551342 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.551651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] PATH_INFO: `/v3/projects/c72aacc5545b46b986c5178fe8dc33bf/users/10192bdef92943d5991f0b4d03d6ae1b/roles/9086c2b2021041caa06abc9556a262a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.553715 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72aacc5545b46b986c5178fe8dc33bf, user_id=10192bdef92943d5991f0b4d03d6ae1b, role_id=9086c2b2021041caa06abc9556a262a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.556317 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.566933 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1393/2822] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:20 2022] PUT /identity/v3/projects/c72aacc5545b46b986c5178fe8dc33bf/users/10192bdef92943d5991f0b4d03d6ae1b/roles/9086c2b2021041caa06abc9556a262a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:20.576864 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.577160 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.577441 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.603032 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] MFA Rules not processed for user `10192bdef92943d5991f0b4d03d6ae1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:20.604241 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:20.670918 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1430/2823] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:20.682945 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:20.684723 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:20.742987 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b51f9-1166-45b6-93d2-05f879f9bfac admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:20.747173 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:20.747806 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:20.748085 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:20.748355 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:20.801523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:20.802883 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252c2bb-8214-460c-ba9d-0611d9e89e14 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:20.811960 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1394/2824] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:23.316204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:23.375413 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfaf8e-ea96-49c0-aee1-a49e4df937ba None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:23.379917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:23.380774 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:23.381060 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:23.381339 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] PATH_INFO: `/v3/users/6d7951060688412fb95f932c5fbd8c6e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:23.382554 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7951060688412fb95f932c5fbd8c6e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:23.384477 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:23.428344 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7951060688412fb95f932c5fbd8c6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.439617 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7951060688412fb95f932c5fbd8c6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.440468 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7951060688412fb95f932c5fbd8c6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.441185 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7951060688412fb95f932c5fbd8c6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.448444 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7951060688412fb95f932c5fbd8c6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.460738 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1431/2825] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:23 2022] DELETE /identity/v3/users/6d7951060688412fb95f932c5fbd8c6e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:23.466518 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:23.466999 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:23.467146 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:23.483811 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:23.485017 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:23.540703 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1395/2826] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:23.550440 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:23.551863 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:23.607052 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032cc1-3d24-4b10-9d89-8d13df28c373 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:23.610672 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:23.611311 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:23.611601 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:23.611880 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:23.620660 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:23.622427 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:23.631594 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1432/2827] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:23.890997 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:23.892673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:23.905885 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089168c0-81c5-49b5-9e69-1ac50297650f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:23.910659 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:23.912341 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:23.912632 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:23.912911 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] PATH_INFO: `/v3/projects/e1cc42783b094edb9f2b5027a3359436` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:23.914112 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cc42783b094edb9f2b5027a3359436)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:23.916093 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:23.963204 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cc42783b094edb9f2b5027a3359436', 'request_id': 'req-bf0b006c-ef20-4264-bf39-66c0e06aff07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.969012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cc42783b094edb9f2b5027a3359436', 'request_id': 'req-bf0b006c-ef20-4264-bf39-66c0e06aff07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.975269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cc42783b094edb9f2b5027a3359436', 'request_id': 'req-bf0b006c-ef20-4264-bf39-66c0e06aff07'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.986795 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] The token cache is being invalidate because project e1cc42783b094edb9f2b5027a3359436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:23.987082 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.987697 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:23.989218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1396/2828] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:23 2022] DELETE /identity/v3/projects/e1cc42783b094edb9f2b5027a3359436 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:07:23.993258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.003794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfa560-9f53-48a4-91b7-a32fa1fdf248 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.060784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.061705 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.062006 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.062381 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] PATH_INFO: `/v3/users/10192bdef92943d5991f0b4d03d6ae1b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.063654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=10192bdef92943d5991f0b4d03d6ae1b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.065770 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.110464 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10192bdef92943d5991f0b4d03d6ae1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.121837 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10192bdef92943d5991f0b4d03d6ae1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.122505 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10192bdef92943d5991f0b4d03d6ae1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.123108 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10192bdef92943d5991f0b4d03d6ae1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.130112 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c74b556e-b495-48d7-a4c1-4dba43f1b1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10192bdef92943d5991f0b4d03d6ae1b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.142848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1433/2829] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:23 2022] DELETE /identity/v3/users/10192bdef92943d5991f0b4d03d6ae1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:24.399453 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.400909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:24.413626 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b006c-ef20-4264-bf39-66c0e06aff07 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.470075 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.470938 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.471245 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.471523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] PATH_INFO: `/v3/projects/c72aacc5545b46b986c5178fe8dc33bf` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.472759 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72aacc5545b46b986c5178fe8dc33bf)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.474688 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.518786 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72aacc5545b46b986c5178fe8dc33bf', 'request_id': 'req-209e0a0d-ad87-4425-b247-31922a6f9e22'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.523887 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72aacc5545b46b986c5178fe8dc33bf', 'request_id': 'req-209e0a0d-ad87-4425-b247-31922a6f9e22'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.530212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72aacc5545b46b986c5178fe8dc33bf', 'request_id': 'req-209e0a0d-ad87-4425-b247-31922a6f9e22'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.541673 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] The token cache is being invalidate because project c72aacc5545b46b986c5178fe8dc33bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:24.541964 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.542573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-209e0a0d-ad87-4425-b247-31922a6f9e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:24.544633 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1397/2830] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:24 2022] DELETE /identity/v3/projects/c72aacc5545b46b986c5178fe8dc33bf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:24.549560 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.550034 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.550141 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.567805 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:24.569030 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:24.625429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1434/2831] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:24.633025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.633316 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.633636 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.652182 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:24.653925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:24.662444 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1398/2832] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:07:24.666525 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.676575 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da6760-eeae-49f3-9080-b01327a6d796 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.681087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.681835 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.682116 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.682392 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.683110 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:07:24.683415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.685065 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.696226 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1435/2833] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:07:24.700440 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.709313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8de090-cedf-44cd-929a-71e39291ab30 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.713896 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.714535 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.714818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.715092 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.716360 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.718270 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.742921 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1399/2834] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:07:24 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:24.747121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.756787 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b195b-a2b8-4503-bf6d-0d4a24a0a4a6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.811011 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.811600 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.811892 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.812175 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.812854 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.814808 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.833949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1436/2835] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:07:24 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:07:24.837955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.850837 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fb665-f540-4237-95e2-abad06233d72 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.855571 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.856442 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.856722 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.856998 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.857754 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.859333 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.870666 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1400/2836] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:24.875056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.884786 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22278c8a-639f-4a5b-ba06-f8be2f512096 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.889949 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.890592 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.890874 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.891405 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.892140 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.893747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de079-cd72-44b8-b12b-bff9ea76c62f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.903816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1437/2837] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:07:24.907817 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:24.917573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540671d-aef0-40aa-a5b3-5ae46bef6c9e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:24.922237 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:24.923131 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.923437 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.923716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] PATH_INFO: `/v3/projects/046936257cc44ca080500045d4b28064/users/7db3b4ea7f2e48caac5d9c1e805345dc/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.937726 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046936257cc44ca080500045d4b28064, user_id=7db3b4ea7f2e48caac5d9c1e805345dc, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:24.940357 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:24.953207 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1401/2838] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:07:24 2022] PUT /identity/v3/projects/046936257cc44ca080500045d4b28064/users/7db3b4ea7f2e48caac5d9c1e805345dc/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:24.964467 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:24.964754 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:24.965031 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:24.990921 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] MFA Rules not processed for user `7db3b4ea7f2e48caac5d9c1e805345dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:07:24.992096 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:25.053013 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1438/2839] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:07:25.064445 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:25.066159 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:25.123201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5107-329c-4ca4-9e90-f25bec27c1b3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:25.126820 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7880dd036c4d1a86a80a3f0a1e6bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:25.127459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:25.127746 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:25.128029 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:25.136188 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:25.138400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:25.147789 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1402/2840] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:28.318654 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:28.320126 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:28.380415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7c4e-ee68-4d13-bb34-9780e6fe8310 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:28.383999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:28.384642 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:28.384926 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:28.385204 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:28.386991 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:28.445540 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:28.447076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:28.457430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1439/2841] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:33.518598 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:33.520307 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:33.532136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042190d-b54b-42aa-835d-fcde49131d76 service glance] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:33.535818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:33.536494 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:33.536785 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:33.537064 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:33.538842 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:33.603141 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:33.604597 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:33.614612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1403/2842] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:40.077278 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:40.079027 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:40.092752 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65aaa-57a0-44ec-a3ec-9bddb8d2320f service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:40.097359 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:40.098262 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:40.098547 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:40.098823 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] PATH_INFO: `/v3/users/70d3a9e2d0a14433a9a8627d15b07ff1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:40.100165 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d3a9e2d0a14433a9a8627d15b07ff1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:40.102955 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:40.148794 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d3a9e2d0a14433a9a8627d15b07ff1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.160810 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d3a9e2d0a14433a9a8627d15b07ff1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.161574 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d3a9e2d0a14433a9a8627d15b07ff1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.162259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d3a9e2d0a14433a9a8627d15b07ff1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.169848 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d3a9e2d0a14433a9a8627d15b07ff1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.182941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1440/2843] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:40 2022] DELETE /identity/v3/users/70d3a9e2d0a14433a9a8627d15b07ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:40.348894 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:40.359381 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbdeea-7cf3-4b4d-bc81-8ada76525a54 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:40.415030 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:40.415903 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:40.416169 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:40.416454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] PATH_INFO: `/v3/projects/3071f6c8fd64408fa45be4bc3a5c3f4d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:40.417648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3071f6c8fd64408fa45be4bc3a5c3f4d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:40.419838 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:40.464194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'request_id': 'req-a5649381-37d5-4a36-a088-2bf65ff81636'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.469538 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'request_id': 'req-a5649381-37d5-4a36-a088-2bf65ff81636'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.475349 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'request_id': 'req-a5649381-37d5-4a36-a088-2bf65ff81636'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.487417 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] The token cache is being invalidate because project 3071f6c8fd64408fa45be4bc3a5c3f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:40.487707 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.488321 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.489853 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1404/2844] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:40 2022] DELETE /identity/v3/projects/3071f6c8fd64408fa45be4bc3a5c3f4d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:40.493783 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:40.495173 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:40.508735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045c0-a9fd-4a03-900e-206dad334565 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:40.563585 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:40.564452 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:40.564740 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:40.565024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] PATH_INFO: `/v3/users/cb2d00ec831a490fbab90de835972a51` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:40.566247 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2d00ec831a490fbab90de835972a51)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:40.568163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:40.611559 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2d00ec831a490fbab90de835972a51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.623555 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2d00ec831a490fbab90de835972a51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.624224 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2d00ec831a490fbab90de835972a51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.624832 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2d00ec831a490fbab90de835972a51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.632635 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2d00ec831a490fbab90de835972a51'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.644647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1441/2845] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:07:40 2022] DELETE /identity/v3/users/cb2d00ec831a490fbab90de835972a51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:40.816138 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:40.817663 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:40.831320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649381-37d5-4a36-a088-2bf65ff81636 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:40.887577 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:40.888441 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:40.888733 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:40.889019 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] PATH_INFO: `/v3/projects/142581fe765c41d0a10bdc8f654e4ee1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:40.890236 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142581fe765c41d0a10bdc8f654e4ee1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:40.892485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:40.936497 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142581fe765c41d0a10bdc8f654e4ee1', 'request_id': 'req-49fc2945-1179-4224-b536-8d681b7bc5b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.941708 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142581fe765c41d0a10bdc8f654e4ee1', 'request_id': 'req-49fc2945-1179-4224-b536-8d681b7bc5b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.947519 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142581fe765c41d0a10bdc8f654e4ee1', 'request_id': 'req-49fc2945-1179-4224-b536-8d681b7bc5b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.959542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] The token cache is being invalidate because project 142581fe765c41d0a10bdc8f654e4ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:07:40.959824 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.960436 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:07:40.961994 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1405/2846] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:07:40 2022] DELETE /identity/v3/projects/142581fe765c41d0a10bdc8f654e4ee1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:07:47.252242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:47.253684 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:47.308941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485e8a-41ec-4fe2-a8ed-b66b73b60289 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:47.356136 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:47.356906 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:47.357192 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:47.357482 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:47.359263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:47.426191 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:47.427622 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:47.438462 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1442/2847] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:07:48.607515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:07:48.609780 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:48.621611 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2945-1179-4224-b536-8d681b7bc5b6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:07:48.625194 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:07:48.625864 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:07:48.626153 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:07:48.626430 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:07:48.628098 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:07:48.640681 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:07:48.642400 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:07:48.652873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1406/2848] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:07:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:04.556024 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:04.565415 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342f92-63e4-4b89-8a09-eeecec559b4d service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:04.569078 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:04.569933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:04.570215 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:04.570489 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:04.572566 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:04.584643 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:04.586573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9cc4b-eaeb-4b93-8297-a6d7cfd20e52 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:04.609315 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1443/2849] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:05.184648 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:05.186889 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:05.251653 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9f-5c63-4c84-90ff-4f592cb44fa1 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:05.256612 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:05.257539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.257830 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.258109 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] PATH_INFO: `/v3/users/7db3b4ea7f2e48caac5d9c1e805345dc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:05.259319 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db3b4ea7f2e48caac5d9c1e805345dc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:05.261260 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:05.310915 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db3b4ea7f2e48caac5d9c1e805345dc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.323080 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db3b4ea7f2e48caac5d9c1e805345dc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.330477 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db3b4ea7f2e48caac5d9c1e805345dc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.331216 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db3b4ea7f2e48caac5d9c1e805345dc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.331816 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db3b4ea7f2e48caac5d9c1e805345dc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.346470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1407/2850] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:08:05 2022] DELETE /identity/v3/users/7db3b4ea7f2e48caac5d9c1e805345dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:05.351163 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.351456 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.351869 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:05.370238 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:05.371518 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:05.430667 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1444/2851] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:05.441724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:05.443234 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:05.501898 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853f099-59ce-4139-b413-2f0dd78d303a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:05.505455 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:05.506118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.506403 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.506716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:05.515454 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:05.517126 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3d95-5179-44a9-947c-977078781747 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:05.526269 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1408/2852] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:08:05.791985 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:05.793589 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:05.807018 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fcea0-410e-43cf-9871-4718667425ff None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:05.812404 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:05.813773 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.814148 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.814516 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] PATH_INFO: `/v3/projects/046936257cc44ca080500045d4b28064` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:05.815877 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=046936257cc44ca080500045d4b28064)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:05.817893 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:05.865995 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046936257cc44ca080500045d4b28064', 'request_id': 'req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.871366 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046936257cc44ca080500045d4b28064', 'request_id': 'req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.878963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046936257cc44ca080500045d4b28064', 'request_id': 'req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.890599 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] The token cache is being invalidate because project 046936257cc44ca080500045d4b28064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:08:05.890889 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.891537 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10d42d5-4aa7-44eb-a2b6-0593652bfe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:05.893710 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1445/2853] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:08:05 2022] DELETE /identity/v3/projects/046936257cc44ca080500045d4b28064 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:05.898279 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.898573 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.898857 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:05.917559 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:05.918910 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:05.986118 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1409/2854] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:05.993686 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:05.993976 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:05.994253 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.012021 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:06.013207 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:06.021820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1446/2855] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:06.026018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.036111 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52fb5-3840-45d3-b948-49aa351f0cc2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.040578 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.041222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.041539 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.041818 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.042558 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:08:06.042863 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.044474 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.056198 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1410/2856] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:08:06.060520 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.069806 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820beb0-5619-4993-bb31-4aba8c06f0b4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.074480 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.075120 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.075403 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.075683 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.077054 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.079571 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.106739 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1447/2857] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:08:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:08:06.111523 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.121251 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff891b-0198-4705-86ec-c3344301b138 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.175496 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.176183 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.176471 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.176755 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.177464 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.179470 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.205040 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1411/2858] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:08:06 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:08:06.206983 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.217300 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4464f-362a-411b-b94a-1307e32da678 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.222437 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.223095 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.223379 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.223658 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.224430 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.226076 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.237094 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1448/2859] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:08:06.240932 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.251288 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e679b5-48d2-4209-a5ca-798ceee5af5e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.255925 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.256588 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.256875 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.257155 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.257914 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.259533 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f85d6-f3a2-4cb2-a9d3-21aa472ce1af admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.269855 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1412/2860] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:08:06.273965 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.283692 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef53f9-0e49-4bf9-a3fa-2ef018d9ded1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.288465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.289341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.289670 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.289948 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] PATH_INFO: `/v3/projects/fd3a767abba84de599b3ba6e26a199c6/users/8526dedda4f04d69bd641f093992c28c/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.304417 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3a767abba84de599b3ba6e26a199c6, user_id=8526dedda4f04d69bd641f093992c28c, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.307087 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.320941 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1449/2861] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:08:06 2022] PUT /identity/v3/projects/fd3a767abba84de599b3ba6e26a199c6/users/8526dedda4f04d69bd641f093992c28c/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:08:06.383386 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.383683 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.383971 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.410955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] MFA Rules not processed for user `8526dedda4f04d69bd641f093992c28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:06.412178 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:06.474200 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1413/2862] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:06.485703 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.487390 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:06.541556 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b958aa-09e7-4445-b687-a4d26f27a346 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.545117 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.545790 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.546815 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.547100 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.555435 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.556909 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bb0d8-c862-4460-b86d-1e294f363b7b service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.566369 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1450/2863] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:06.591757 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.659133 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f17b-f323-4ff8-9c49-4071252b24b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.665018 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.665950 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.666240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.666521 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] PATH_INFO: `/v3/users/8526dedda4f04d69bd641f093992c28c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.667724 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8526dedda4f04d69bd641f093992c28c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.669676 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.715957 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8526dedda4f04d69bd641f093992c28c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:06.727456 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8526dedda4f04d69bd641f093992c28c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:06.734420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8526dedda4f04d69bd641f093992c28c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:06.735104 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8526dedda4f04d69bd641f093992c28c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:06.735720 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8526dedda4f04d69bd641f093992c28c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:06.747893 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1414/2864] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:08:06 2022] DELETE /identity/v3/users/8526dedda4f04d69bd641f093992c28c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:06.753103 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.753422 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.753735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.770981 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:06.772166 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:06.829355 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1451/2865] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:06.838892 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:06.840415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:06.898485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00969c-3e66-43f8-b840-432ab7e90d20 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:06.902861 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:06.903677 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:06.904004 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:06.904295 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:06.913672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:06.915652 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847762c-bc6d-41c0-a273-e93329fb8232 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:06.927512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1415/2866] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:07.228242 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.230174 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:07.246872 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8765c-7a3c-44b3-8f8d-1f48e40b7338 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.252088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.252939 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.253252 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.253561 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] PATH_INFO: `/v3/projects/fd3a767abba84de599b3ba6e26a199c6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.254742 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3a767abba84de599b3ba6e26a199c6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.256735 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.302239 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3a767abba84de599b3ba6e26a199c6', 'request_id': 'req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:07.307743 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3a767abba84de599b3ba6e26a199c6', 'request_id': 'req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:07.314816 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3a767abba84de599b3ba6e26a199c6', 'request_id': 'req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:07.328460 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] The token cache is being invalidate because project fd3a767abba84de599b3ba6e26a199c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:08:07.328747 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:07.329716 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e536f13a-ff11-4f9a-b21c-b8dad0348a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:07.331495 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1452/2867] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:08:07 2022] DELETE /identity/v3/projects/fd3a767abba84de599b3ba6e26a199c6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:07.336807 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.337315 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.337435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.356306 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:07.357525 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:07.417101 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1416/2868] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:07.425963 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.426258 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.426565 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.444357 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:07.445593 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:07.453866 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1453/2869] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:07.458048 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.467651 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504c8a-65de-4eb5-98ee-7cb1f058f512 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.473416 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.474100 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.474387 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.474672 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.475404 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:08:07.475717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.477313 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.489420 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1417/2870] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 11 06:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:08:07.493820 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.504471 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc18f-8271-4d34-adaf-544a4ccc22a2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.510341 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.510999 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.511429 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.511911 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.512870 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.515714 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.540229 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1454/2871] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 11 06:08:07 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:08:07.544347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.554290 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a380-dd57-4bfd-a764-c21423843b54 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.611991 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.612675 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.612962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.613240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.614012 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.615955 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.636574 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1418/2872] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 11 06:08:07 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:08:07.641169 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.651514 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c354f-ba4c-4710-8b8d-c0538fcb72bc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.656908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.657602 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.657896 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.658180 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.658908 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.660515 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.671481 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1455/2873] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:08:07.675542 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.685240 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7a2c-e216-4b96-ad1b-d914cb68525a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.690063 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.690717 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.691002 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.691282 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.692009 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.693621 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8eb3-2694-43e1-854d-85095f3f4b44 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.703869 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1419/2874] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 11 06:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:08:07.708171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.717875 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b78c1-e539-42bb-86f9-b25a0c408699 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.723298 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.724171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.724461 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.724744 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] PATH_INFO: `/v3/projects/d900645c4225443faac1823ec579461e/users/d8bf7363f284436fb816518f057dc550/roles/47bff6418933442081338f0ba924ff4a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.740573 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d900645c4225443faac1823ec579461e, user_id=d8bf7363f284436fb816518f057dc550, role_id=47bff6418933442081338f0ba924ff4a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.743295 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.756227 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1456/2875] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 11 06:08:07 2022] PUT /identity/v3/projects/d900645c4225443faac1823ec579461e/users/d8bf7363f284436fb816518f057dc550/roles/47bff6418933442081338f0ba924ff4a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:07.768839 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.769130 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.769412 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.795390 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] MFA Rules not processed for user `d8bf7363f284436fb816518f057dc550`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:07.796587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:07.858791 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1420/2876] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:07.870411 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:07.872194 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:07.927586 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690a67-3a9e-4b9f-b437-9b2bbe2f331e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:07.931283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a422e2a9c3640e888f2743aa9c7c199', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:07.931925 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:07.932213 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:07.932496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:07.941142 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:07.942615 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9106-d608-4d96-922b-c592e98a2805 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:07.951223 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1457/2877] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:17.013121 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:17.074899 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea3c1-232c-4a66-b45c-2f2fd2d11170 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:17.079509 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:17.080310 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:17.080594 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:17.080873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] PATH_INFO: `/v3/users/d8bf7363f284436fb816518f057dc550` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:17.082087 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bf7363f284436fb816518f057dc550)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:17.084023 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:17.128271 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bf7363f284436fb816518f057dc550'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.139353 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bf7363f284436fb816518f057dc550'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.146243 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bf7363f284436fb816518f057dc550'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.146909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bf7363f284436fb816518f057dc550'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.147512 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bf7363f284436fb816518f057dc550'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.160873 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1421/2878] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:08:17 2022] DELETE /identity/v3/users/d8bf7363f284436fb816518f057dc550 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:17.165465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:17.166007 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:17.166129 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:17.184276 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] MFA Rules not processed for user `f9be91d729474890b96917c482066429`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:08:17.185496 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:17.244306 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1458/2879] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 11 06:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:08:17.254988 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:17.256435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:17.316222 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108d625-b9b2-463a-8061-53274fea9ec3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:17.320218 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:17.320872 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:17.321157 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:17.321435 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:17.331209 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:17.332617 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:17.342025 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1422/2880] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:17.607263 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:17.609044 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:17.621327 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb792-735a-40fb-9968-3deba8c30b92 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:17.627428 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:17.628733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:17.628733 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:17.628964 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] PATH_INFO: `/v3/projects/d900645c4225443faac1823ec579461e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:17.630121 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d900645c4225443faac1823ec579461e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:17.632028 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:17.677841 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd900645c4225443faac1823ec579461e', 'request_id': 'req-8f49e1d6-d3fb-4666-953e-66737f7ed907'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.683056 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd900645c4225443faac1823ec579461e', 'request_id': 'req-8f49e1d6-d3fb-4666-953e-66737f7ed907'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.691506 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd900645c4225443faac1823ec579461e', 'request_id': 'req-8f49e1d6-d3fb-4666-953e-66737f7ed907'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.702958 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] The token cache is being invalidate because project d900645c4225443faac1823ec579461e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:08:17.703250 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.703903 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:17.705433 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1459/2881] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:08:17 2022] DELETE /identity/v3/projects/d900645c4225443faac1823ec579461e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:18.247985 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:18.250061 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:18.261074 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216aac-a482-40f5-b77d-ddff869b72f8 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:18.307211 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc3cba26628440a84f722b77f4e1f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:18.307851 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:18.308136 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:18.308415 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:18.310163 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:18.369127 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:18.370587 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:18.380909 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1423/2882] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:08:24.691457 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:24.692933 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:24.706919 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49e1d6-d3fb-4666-953e-66737f7ed907 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:24.711647 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:24.712519 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:24.712809 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:24.713088 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] PATH_INFO: `/v3/users/bbc14e1f89334e65b24fec7b4a321c5d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:24.714317 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc14e1f89334e65b24fec7b4a321c5d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:24.716246 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:24.765917 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc14e1f89334e65b24fec7b4a321c5d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:24.778857 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc14e1f89334e65b24fec7b4a321c5d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:24.779701 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc14e1f89334e65b24fec7b4a321c5d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:24.781025 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc14e1f89334e65b24fec7b4a321c5d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:24.789624 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc14e1f89334e65b24fec7b4a321c5d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:24.802621 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1460/2883] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:08:24 2022] DELETE /identity/v3/users/bbc14e1f89334e65b24fec7b4a321c5d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:24.972881 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:24.984283 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95ae1-757a-41fc-b410-1c6d62725c2d service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:25.043347 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:25.044201 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:25.044485 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:25.044761 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] PATH_INFO: `/v3/projects/12ba636dcfc34045b8b7fd82fa770bc0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:25.046026 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ba636dcfc34045b8b7fd82fa770bc0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:25.047917 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:25.091343 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ba636dcfc34045b8b7fd82fa770bc0', 'request_id': 'req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.097212 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ba636dcfc34045b8b7fd82fa770bc0', 'request_id': 'req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.103253 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ba636dcfc34045b8b7fd82fa770bc0', 'request_id': 'req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.115616 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] The token cache is being invalidate because project 12ba636dcfc34045b8b7fd82fa770bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:08:25.115912 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.116540 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.118114 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1424/2884] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:08:24 2022] DELETE /identity/v3/projects/12ba636dcfc34045b8b7fd82fa770bc0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:25.122084 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:25.123704 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:25.137937 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0cbe4-51c8-4d1f-9a68-05a27eb68d8a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:25.195171 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:25.196048 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:25.196331 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:25.196608 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] PATH_INFO: `/v3/users/97d51f046add49a9a991b55cbede2e89` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:25.197811 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d51f046add49a9a991b55cbede2e89)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:25.199724 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:25.244038 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d51f046add49a9a991b55cbede2e89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.255730 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d51f046add49a9a991b55cbede2e89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.256391 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d51f046add49a9a991b55cbede2e89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.257002 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d51f046add49a9a991b55cbede2e89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.264486 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d51f046add49a9a991b55cbede2e89'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.276961 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1461/2885] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 11 06:08:25 2022] DELETE /identity/v3/users/97d51f046add49a9a991b55cbede2e89 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:08:25.441962 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:08:25.443515 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:08:25.456689 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05a78-bf7d-4623-a7ec-e6cac33a69c2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:08:25.516658 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9be91d729474890b96917c482066429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092ac42400414e84802b398999ca7422', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:08:25.517716 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:08:25.517996 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:08:25.518273 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] PATH_INFO: `/v3/projects/d35aae6b03cb456c96348d9c6b008ab1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:08:25.519459 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35aae6b03cb456c96348d9c6b008ab1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:08:25.521331 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:08:25.569320 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35aae6b03cb456c96348d9c6b008ab1', 'request_id': 'req-bb9fc0a6-327e-49bb-aac4-66421a9796d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.574852 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35aae6b03cb456c96348d9c6b008ab1', 'request_id': 'req-bb9fc0a6-327e-49bb-aac4-66421a9796d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.581053 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35aae6b03cb456c96348d9c6b008ab1', 'request_id': 'req-bb9fc0a6-327e-49bb-aac4-66421a9796d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.593843 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] The token cache is being invalidate because project d35aae6b03cb456c96348d9c6b008ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:08:25.594134 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.594805 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bb9fc0a6-327e-49bb-aac4-66421a9796d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:08:25.596392 dv-cinder-733623-13-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1425/2886] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 11 06:08:25 2022] DELETE /identity/v3/projects/d35aae6b03cb456c96348d9c6b008ab1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:12:04.797653 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:12:04.799075 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:12:04.945465 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc70ec-56fd-479f-ae3a-3243a512015f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:12:05.003318 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb48776ee54747dfbab78d9caf1f1fbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a65dbd124234f9eb1215aabf56bfc06', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:12:05.003970 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:12:05.004259 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:12:05.004542 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:12:05.006332 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:12:05.017784 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:12:05.019373 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f59f5-3d7c-4145-a8b1-35e2ee182875 service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:12:05.029283 dv-cinder-733623-13-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1462/2887] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 11 06:12:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)